2023-07-12 16:14:11,640 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-12 16:14:11,889 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913 2023-07-12 16:14:11,889 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-12 16:14:11,890 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-12 16:14:11,937 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 16:14:12,230 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 16:14:12,231 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f, deleteOnExit=true 2023-07-12 16:14:12,231 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 16:14:12,232 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/test.cache.data in system properties and HBase conf 2023-07-12 16:14:12,232 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 16:14:12,233 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop.log.dir in system properties and HBase conf 2023-07-12 16:14:12,234 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 16:14:12,234 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 16:14:12,235 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 16:14:12,640 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 16:14:12,645 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 16:14:12,646 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 16:14:12,646 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 16:14:12,647 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 16:14:12,647 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 16:14:12,648 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 16:14:12,648 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 16:14:12,648 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 16:14:12,649 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 16:14:12,649 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/nfs.dump.dir in system properties and HBase conf 2023-07-12 16:14:12,650 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/java.io.tmpdir in system properties and HBase conf 2023-07-12 16:14:12,650 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 16:14:12,650 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 16:14:12,651 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 16:14:13,310 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 16:14:13,315 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 16:14:13,659 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 16:14:13,852 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 16:14:13,872 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:13,927 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:13,967 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/java.io.tmpdir/Jetty_localhost_34407_hdfs____dyaaqs/webapp 2023-07-12 16:14:14,126 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34407 2023-07-12 16:14:14,137 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 16:14:14,138 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 16:14:14,677 WARN [Listener at localhost/46851] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 16:14:14,773 WARN [Listener at localhost/46851] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 16:14:14,799 WARN [Listener at localhost/46851] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:14,807 INFO [Listener at localhost/46851] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:14,854 INFO [Listener at localhost/46851] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/java.io.tmpdir/Jetty_localhost_41051_datanode____t2igt2/webapp 2023-07-12 16:14:14,991 INFO [Listener at localhost/46851] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41051 2023-07-12 16:14:15,605 WARN [Listener at localhost/38049] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 16:14:15,631 WARN [Listener at localhost/38049] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 16:14:15,635 WARN [Listener at localhost/38049] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:15,637 INFO [Listener at localhost/38049] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:15,647 INFO [Listener at localhost/38049] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/java.io.tmpdir/Jetty_localhost_46401_datanode____.doal9i/webapp 2023-07-12 16:14:15,787 INFO [Listener at localhost/38049] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46401 2023-07-12 16:14:15,849 WARN [Listener at localhost/38039] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 16:14:15,909 WARN [Listener at localhost/38039] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 16:14:15,920 WARN [Listener at localhost/38039] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:15,922 INFO [Listener at localhost/38039] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:15,935 INFO [Listener at localhost/38039] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/java.io.tmpdir/Jetty_localhost_43557_datanode____.yby7oh/webapp 2023-07-12 16:14:16,104 INFO [Listener at localhost/38039] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43557 2023-07-12 16:14:16,151 WARN [Listener at localhost/36467] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 16:14:16,434 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7690cf579e21c182: Processing first storage report for DS-0403c1e5-190c-4817-b6a6-b668e3823e49 from datanode eae0ca6d-7dbe-41be-adf4-ce191908d896 2023-07-12 16:14:16,436 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7690cf579e21c182: from storage DS-0403c1e5-190c-4817-b6a6-b668e3823e49 node DatanodeRegistration(127.0.0.1:43371, datanodeUuid=eae0ca6d-7dbe-41be-adf4-ce191908d896, infoPort=41921, infoSecurePort=0, ipcPort=38049, storageInfo=lv=-57;cid=testClusterID;nsid=1908187780;c=1689178453407), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-12 16:14:16,437 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb2f334486a68e433: Processing first storage report for DS-9b773c85-7f52-4721-bd28-52b5f5206fa5 from datanode d1957b33-51a1-4bb1-8161-180ae576f319 2023-07-12 16:14:16,437 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb2f334486a68e433: from storage DS-9b773c85-7f52-4721-bd28-52b5f5206fa5 node DatanodeRegistration(127.0.0.1:42735, datanodeUuid=d1957b33-51a1-4bb1-8161-180ae576f319, infoPort=36269, infoSecurePort=0, ipcPort=38039, storageInfo=lv=-57;cid=testClusterID;nsid=1908187780;c=1689178453407), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 16:14:16,437 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5440bdb4c66809a3: Processing first storage report for DS-aedfbf35-3ac8-4348-8dc8-5458df716a0f from datanode 2e1e58fb-1c56-41bf-94a7-d8ec9f8440df 2023-07-12 16:14:16,437 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5440bdb4c66809a3: from storage DS-aedfbf35-3ac8-4348-8dc8-5458df716a0f node DatanodeRegistration(127.0.0.1:36371, datanodeUuid=2e1e58fb-1c56-41bf-94a7-d8ec9f8440df, infoPort=41973, infoSecurePort=0, ipcPort=36467, storageInfo=lv=-57;cid=testClusterID;nsid=1908187780;c=1689178453407), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 16:14:16,437 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7690cf579e21c182: Processing first storage report for DS-689f9611-bf07-48ee-9f39-641c36ef1a68 from datanode eae0ca6d-7dbe-41be-adf4-ce191908d896 2023-07-12 16:14:16,438 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7690cf579e21c182: from storage DS-689f9611-bf07-48ee-9f39-641c36ef1a68 node DatanodeRegistration(127.0.0.1:43371, datanodeUuid=eae0ca6d-7dbe-41be-adf4-ce191908d896, infoPort=41921, infoSecurePort=0, ipcPort=38049, storageInfo=lv=-57;cid=testClusterID;nsid=1908187780;c=1689178453407), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 16:14:16,438 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb2f334486a68e433: Processing first storage report for DS-c83a968b-1513-4d1b-80f6-8e9bb7a1af94 from datanode d1957b33-51a1-4bb1-8161-180ae576f319 2023-07-12 16:14:16,438 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb2f334486a68e433: from storage DS-c83a968b-1513-4d1b-80f6-8e9bb7a1af94 node DatanodeRegistration(127.0.0.1:42735, datanodeUuid=d1957b33-51a1-4bb1-8161-180ae576f319, infoPort=36269, infoSecurePort=0, ipcPort=38039, storageInfo=lv=-57;cid=testClusterID;nsid=1908187780;c=1689178453407), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 16:14:16,438 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5440bdb4c66809a3: Processing first storage report for DS-24dda936-18a1-43fe-a85b-943fc78cd06e from datanode 2e1e58fb-1c56-41bf-94a7-d8ec9f8440df 2023-07-12 16:14:16,438 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5440bdb4c66809a3: from storage DS-24dda936-18a1-43fe-a85b-943fc78cd06e node DatanodeRegistration(127.0.0.1:36371, datanodeUuid=2e1e58fb-1c56-41bf-94a7-d8ec9f8440df, infoPort=41973, infoSecurePort=0, ipcPort=36467, storageInfo=lv=-57;cid=testClusterID;nsid=1908187780;c=1689178453407), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 16:14:16,739 DEBUG [Listener at localhost/36467] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913 2023-07-12 16:14:16,856 INFO [Listener at localhost/36467] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/zookeeper_0, clientPort=53717, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 16:14:16,884 INFO [Listener at localhost/36467] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53717 2023-07-12 16:14:16,902 INFO [Listener at localhost/36467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:16,905 INFO [Listener at localhost/36467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:17,634 INFO [Listener at localhost/36467] util.FSUtils(471): Created version file at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 with version=8 2023-07-12 16:14:17,634 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/hbase-staging 2023-07-12 16:14:18,067 INFO [Listener at localhost/36467] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 16:14:18,675 INFO [Listener at localhost/36467] client.ConnectionUtils(127): master/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 16:14:18,709 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:18,709 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:18,709 INFO [Listener at localhost/36467] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 16:14:18,710 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:18,710 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 16:14:18,867 INFO [Listener at localhost/36467] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 16:14:18,944 DEBUG [Listener at localhost/36467] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 16:14:19,071 INFO [Listener at localhost/36467] ipc.NettyRpcServer(120): Bind to /172.31.10.131:43373 2023-07-12 16:14:19,090 INFO [Listener at localhost/36467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,093 INFO [Listener at localhost/36467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,124 INFO [Listener at localhost/36467] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43373 connecting to ZooKeeper ensemble=127.0.0.1:53717 2023-07-12 16:14:19,201 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:433730x0, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 16:14:19,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43373-0x101c5ec8d560000 connected 2023-07-12 16:14:19,254 DEBUG [Listener at localhost/36467] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 16:14:19,255 DEBUG [Listener at localhost/36467] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:14:19,274 DEBUG [Listener at localhost/36467] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 16:14:19,287 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43373 2023-07-12 16:14:19,291 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43373 2023-07-12 16:14:19,292 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43373 2023-07-12 16:14:19,292 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43373 2023-07-12 16:14:19,292 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43373 2023-07-12 16:14:19,301 INFO [Listener at localhost/36467] master.HMaster(444): hbase.rootdir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756, hbase.cluster.distributed=false 2023-07-12 16:14:19,405 INFO [Listener at localhost/36467] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 16:14:19,405 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,405 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,406 INFO [Listener at localhost/36467] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 16:14:19,406 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,406 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 16:14:19,412 INFO [Listener at localhost/36467] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 16:14:19,416 INFO [Listener at localhost/36467] ipc.NettyRpcServer(120): Bind to /172.31.10.131:44777 2023-07-12 16:14:19,420 INFO [Listener at localhost/36467] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 16:14:19,430 INFO [Listener at localhost/36467] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 16:14:19,431 INFO [Listener at localhost/36467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,434 INFO [Listener at localhost/36467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,437 INFO [Listener at localhost/36467] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44777 connecting to ZooKeeper ensemble=127.0.0.1:53717 2023-07-12 16:14:19,446 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:447770x0, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 16:14:19,447 DEBUG [Listener at localhost/36467] zookeeper.ZKUtil(164): regionserver:447770x0, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 16:14:19,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44777-0x101c5ec8d560001 connected 2023-07-12 16:14:19,448 DEBUG [Listener at localhost/36467] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:14:19,449 DEBUG [Listener at localhost/36467] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 16:14:19,457 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44777 2023-07-12 16:14:19,458 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44777 2023-07-12 16:14:19,458 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44777 2023-07-12 16:14:19,459 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44777 2023-07-12 16:14:19,459 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44777 2023-07-12 16:14:19,475 INFO [Listener at localhost/36467] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 16:14:19,475 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,476 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,476 INFO [Listener at localhost/36467] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 16:14:19,477 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,477 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 16:14:19,477 INFO [Listener at localhost/36467] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 16:14:19,479 INFO [Listener at localhost/36467] ipc.NettyRpcServer(120): Bind to /172.31.10.131:41787 2023-07-12 16:14:19,479 INFO [Listener at localhost/36467] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 16:14:19,483 INFO [Listener at localhost/36467] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 16:14:19,484 INFO [Listener at localhost/36467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,487 INFO [Listener at localhost/36467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,489 INFO [Listener at localhost/36467] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41787 connecting to ZooKeeper ensemble=127.0.0.1:53717 2023-07-12 16:14:19,495 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:417870x0, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 16:14:19,496 DEBUG [Listener at localhost/36467] zookeeper.ZKUtil(164): regionserver:417870x0, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 16:14:19,497 DEBUG [Listener at localhost/36467] zookeeper.ZKUtil(164): regionserver:417870x0, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:14:19,498 DEBUG [Listener at localhost/36467] zookeeper.ZKUtil(164): regionserver:417870x0, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 16:14:19,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41787-0x101c5ec8d560002 connected 2023-07-12 16:14:19,504 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41787 2023-07-12 16:14:19,504 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41787 2023-07-12 16:14:19,507 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41787 2023-07-12 16:14:19,508 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41787 2023-07-12 16:14:19,508 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41787 2023-07-12 16:14:19,521 INFO [Listener at localhost/36467] client.ConnectionUtils(127): regionserver/jenkins-hbase5:0 server-side Connection retries=45 2023-07-12 16:14:19,522 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,522 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,522 INFO [Listener at localhost/36467] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 16:14:19,522 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 16:14:19,523 INFO [Listener at localhost/36467] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 16:14:19,523 INFO [Listener at localhost/36467] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 16:14:19,525 INFO [Listener at localhost/36467] ipc.NettyRpcServer(120): Bind to /172.31.10.131:43171 2023-07-12 16:14:19,526 INFO [Listener at localhost/36467] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 16:14:19,527 INFO [Listener at localhost/36467] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 16:14:19,528 INFO [Listener at localhost/36467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,530 INFO [Listener at localhost/36467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,531 INFO [Listener at localhost/36467] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43171 connecting to ZooKeeper ensemble=127.0.0.1:53717 2023-07-12 16:14:19,537 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:431710x0, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 16:14:19,538 DEBUG [Listener at localhost/36467] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 16:14:19,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43171-0x101c5ec8d560003 connected 2023-07-12 16:14:19,539 DEBUG [Listener at localhost/36467] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:14:19,540 DEBUG [Listener at localhost/36467] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 16:14:19,540 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43171 2023-07-12 16:14:19,540 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43171 2023-07-12 16:14:19,543 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43171 2023-07-12 16:14:19,544 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43171 2023-07-12 16:14:19,544 DEBUG [Listener at localhost/36467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43171 2023-07-12 16:14:19,546 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase5.apache.org,43373,1689178457825 2023-07-12 16:14:19,557 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 16:14:19,559 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase5.apache.org,43373,1689178457825 2023-07-12 16:14:19,583 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 16:14:19,583 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 16:14:19,583 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 16:14:19,584 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:19,587 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 16:14:19,590 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 16:14:19,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 16:14:19,592 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase5.apache.org,43373,1689178457825 from backup master directory 2023-07-12 16:14:19,597 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase5.apache.org,43373,1689178457825 2023-07-12 16:14:19,597 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 16:14:19,598 WARN [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 16:14:19,599 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase5.apache.org,43373,1689178457825 2023-07-12 16:14:19,603 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 16:14:19,605 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 16:14:19,755 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/hbase.id with ID: 7f4a199f-c234-4579-a063-e8097f3f3991 2023-07-12 16:14:19,814 INFO [master/jenkins-hbase5:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 16:14:19,834 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:19,908 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x02020cb0 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:19,955 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35d1118b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:19,984 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 16:14:19,986 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 16:14:20,009 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 16:14:20,010 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 16:14:20,013 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 16:14:20,018 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 16:14:20,020 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 16:14:20,060 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/MasterData/data/master/store-tmp 2023-07-12 16:14:20,106 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:20,106 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 16:14:20,106 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:14:20,106 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:14:20,106 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 16:14:20,107 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:14:20,107 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:14:20,107 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 16:14:20,109 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/MasterData/WALs/jenkins-hbase5.apache.org,43373,1689178457825 2023-07-12 16:14:20,137 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C43373%2C1689178457825, suffix=, logDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/MasterData/WALs/jenkins-hbase5.apache.org,43373,1689178457825, archiveDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/MasterData/oldWALs, maxLogs=10 2023-07-12 16:14:20,250 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36371,DS-aedfbf35-3ac8-4348-8dc8-5458df716a0f,DISK] 2023-07-12 16:14:20,250 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42735,DS-9b773c85-7f52-4721-bd28-52b5f5206fa5,DISK] 2023-07-12 16:14:20,251 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43371,DS-0403c1e5-190c-4817-b6a6-b668e3823e49,DISK] 2023-07-12 16:14:20,263 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 16:14:20,376 INFO [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/MasterData/WALs/jenkins-hbase5.apache.org,43373,1689178457825/jenkins-hbase5.apache.org%2C43373%2C1689178457825.1689178460154 2023-07-12 16:14:20,376 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36371,DS-aedfbf35-3ac8-4348-8dc8-5458df716a0f,DISK], DatanodeInfoWithStorage[127.0.0.1:42735,DS-9b773c85-7f52-4721-bd28-52b5f5206fa5,DISK], DatanodeInfoWithStorage[127.0.0.1:43371,DS-0403c1e5-190c-4817-b6a6-b668e3823e49,DISK]] 2023-07-12 16:14:20,377 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 16:14:20,377 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:20,382 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 16:14:20,384 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 16:14:20,458 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 16:14:20,465 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 16:14:20,494 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 16:14:20,507 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:20,514 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 16:14:20,516 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 16:14:20,533 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 16:14:20,543 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:20,544 INFO [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74476342, jitterRate=0.10978397727012634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:20,544 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 16:14:20,546 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 16:14:20,579 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 16:14:20,579 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 16:14:20,583 INFO [master/jenkins-hbase5:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 16:14:20,585 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 16:14:20,628 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 42 msec 2023-07-12 16:14:20,629 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 16:14:20,668 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 16:14:20,674 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 16:14:20,702 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 16:14:20,708 INFO [master/jenkins-hbase5:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 16:14:20,710 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 16:14:20,718 INFO [master/jenkins-hbase5:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 16:14:20,724 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 16:14:20,728 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:20,730 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 16:14:20,730 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 16:14:20,746 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 16:14:20,751 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 16:14:20,751 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 16:14:20,751 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 16:14:20,751 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 16:14:20,751 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:20,754 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase5.apache.org,43373,1689178457825, sessionid=0x101c5ec8d560000, setting cluster-up flag (Was=false) 2023-07-12 16:14:20,771 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:20,778 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 16:14:20,780 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,43373,1689178457825 2023-07-12 16:14:20,787 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:20,794 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 16:14:20,797 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase5.apache.org,43373,1689178457825 2023-07-12 16:14:20,801 WARN [master/jenkins-hbase5:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp 2023-07-12 16:14:20,860 INFO [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(951): ClusterId : 7f4a199f-c234-4579-a063-e8097f3f3991 2023-07-12 16:14:20,862 INFO [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(951): ClusterId : 7f4a199f-c234-4579-a063-e8097f3f3991 2023-07-12 16:14:20,869 DEBUG [RS:1;jenkins-hbase5:41787] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 16:14:20,871 INFO [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(951): ClusterId : 7f4a199f-c234-4579-a063-e8097f3f3991 2023-07-12 16:14:20,869 DEBUG [RS:0;jenkins-hbase5:44777] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 16:14:20,872 DEBUG [RS:2;jenkins-hbase5:43171] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 16:14:20,881 DEBUG [RS:1;jenkins-hbase5:41787] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 16:14:20,881 DEBUG [RS:0;jenkins-hbase5:44777] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 16:14:20,882 DEBUG [RS:0;jenkins-hbase5:44777] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 16:14:20,881 DEBUG [RS:1;jenkins-hbase5:41787] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 16:14:20,882 DEBUG [RS:2;jenkins-hbase5:43171] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 16:14:20,882 DEBUG [RS:2;jenkins-hbase5:43171] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 16:14:20,887 DEBUG [RS:1;jenkins-hbase5:41787] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 16:14:20,887 DEBUG [RS:0;jenkins-hbase5:44777] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 16:14:20,890 DEBUG [RS:2;jenkins-hbase5:43171] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 16:14:20,892 DEBUG [RS:2;jenkins-hbase5:43171] zookeeper.ReadOnlyZKClient(139): Connect 0x4c075bd0 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:20,894 DEBUG [RS:0;jenkins-hbase5:44777] zookeeper.ReadOnlyZKClient(139): Connect 0x2079b8bc to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:20,909 DEBUG [RS:1;jenkins-hbase5:41787] zookeeper.ReadOnlyZKClient(139): Connect 0x7ddad224 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:20,941 DEBUG [RS:2;jenkins-hbase5:43171] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42c0bc20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:20,943 DEBUG [RS:2;jenkins-hbase5:43171] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46ff30a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 16:14:20,961 DEBUG [RS:0;jenkins-hbase5:44777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ebe42c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:20,962 DEBUG [RS:0;jenkins-hbase5:44777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a81d3cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 16:14:20,980 DEBUG [RS:1;jenkins-hbase5:41787] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@731d33ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:20,980 DEBUG [RS:1;jenkins-hbase5:41787] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7722b954, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 16:14:20,992 DEBUG [RS:1;jenkins-hbase5:41787] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase5:41787 2023-07-12 16:14:20,994 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-12 16:14:20,992 DEBUG [RS:0;jenkins-hbase5:44777] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase5:44777 2023-07-12 16:14:20,995 DEBUG [RS:2;jenkins-hbase5:43171] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase5:43171 2023-07-12 16:14:20,999 INFO [RS:1;jenkins-hbase5:41787] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 16:14:20,999 INFO [RS:2;jenkins-hbase5:43171] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 16:14:20,999 INFO [RS:2;jenkins-hbase5:43171] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 16:14:20,999 INFO [RS:1;jenkins-hbase5:41787] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 16:14:21,001 DEBUG [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 16:14:21,001 DEBUG [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 16:14:21,001 INFO [master/jenkins-hbase5:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:20,999 INFO [RS:0;jenkins-hbase5:44777] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 16:14:21,003 INFO [RS:0;jenkins-hbase5:44777] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 16:14:21,003 INFO [master/jenkins-hbase5:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-12 16:14:21,003 DEBUG [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 16:14:21,003 INFO [RS:0;jenkins-hbase5:44777] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:21,003 DEBUG [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 16:14:21,006 INFO [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,43373,1689178457825 with isa=jenkins-hbase5.apache.org/172.31.10.131:44777, startcode=1689178459404 2023-07-12 16:14:21,002 INFO [RS:1;jenkins-hbase5:41787] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:21,002 INFO [RS:2;jenkins-hbase5:43171] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:21,007 DEBUG [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 16:14:21,006 DEBUG [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 16:14:21,008 INFO [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,43373,1689178457825 with isa=jenkins-hbase5.apache.org/172.31.10.131:43171, startcode=1689178459521 2023-07-12 16:14:21,008 INFO [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,43373,1689178457825 with isa=jenkins-hbase5.apache.org/172.31.10.131:41787, startcode=1689178459474 2023-07-12 16:14:21,030 DEBUG [RS:2;jenkins-hbase5:43171] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 16:14:21,030 DEBUG [RS:1;jenkins-hbase5:41787] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 16:14:21,031 DEBUG [RS:0;jenkins-hbase5:44777] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 16:14:21,134 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:46209, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 16:14:21,134 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:41965, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 16:14:21,134 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:35129, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 16:14:21,166 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 16:14:21,167 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43373] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 16:14:21,178 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 16:14:21,178 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 16:14:21,178 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 16:14:21,178 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=5, maxPoolSize=5 2023-07-12 16:14:21,179 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase5:0, corePoolSize=10, maxPoolSize=10 2023-07-12 16:14:21,179 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,179 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 16:14:21,179 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,183 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43373] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 16:14:21,184 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43373] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 16:14:21,195 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689178491195 2023-07-12 16:14:21,198 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 16:14:21,209 DEBUG [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 16:14:21,210 DEBUG [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 16:14:21,210 WARN [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 16:14:21,209 DEBUG [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 16:14:21,211 WARN [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 16:14:21,210 WARN [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 16:14:21,211 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 16:14:21,215 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 16:14:21,216 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 16:14:21,219 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 16:14:21,219 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 16:14:21,220 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 16:14:21,220 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 16:14:21,221 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 16:14:21,224 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,232 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 16:14:21,234 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 16:14:21,234 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 16:14:21,238 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 16:14:21,239 INFO [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 16:14:21,241 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689178461241,5,FailOnTimeoutGroup] 2023-07-12 16:14:21,241 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689178461241,5,FailOnTimeoutGroup] 2023-07-12 16:14:21,241 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,241 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 16:14:21,243 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,244 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,312 INFO [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,43373,1689178457825 with isa=jenkins-hbase5.apache.org/172.31.10.131:44777, startcode=1689178459404 2023-07-12 16:14:21,313 INFO [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,43373,1689178457825 with isa=jenkins-hbase5.apache.org/172.31.10.131:41787, startcode=1689178459474 2023-07-12 16:14:21,313 INFO [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase5.apache.org,43373,1689178457825 with isa=jenkins-hbase5.apache.org/172.31.10.131:43171, startcode=1689178459521 2023-07-12 16:14:21,320 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43373] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:21,324 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 16:14:21,325 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 16:14:21,325 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:14:21,330 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43373] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:21,331 DEBUG [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:14:21,332 DEBUG [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46851 2023-07-12 16:14:21,332 DEBUG [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 16:14:21,333 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43373] master.ServerManager(394): Registering regionserver=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:21,338 DEBUG [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:14:21,338 DEBUG [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46851 2023-07-12 16:14:21,338 DEBUG [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 16:14:21,339 DEBUG [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:14:21,339 DEBUG [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46851 2023-07-12 16:14:21,339 DEBUG [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 16:14:21,341 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 16:14:21,348 DEBUG [RS:1;jenkins-hbase5:41787] zookeeper.ZKUtil(162): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:21,348 DEBUG [RS:0;jenkins-hbase5:44777] zookeeper.ZKUtil(162): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:21,348 DEBUG [RS:2;jenkins-hbase5:43171] zookeeper.ZKUtil(162): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:21,350 WARN [RS:2;jenkins-hbase5:43171] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 16:14:21,350 INFO [RS:2;jenkins-hbase5:43171] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 16:14:21,350 DEBUG [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/WALs/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:21,348 WARN [RS:0;jenkins-hbase5:44777] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 16:14:21,348 WARN [RS:1;jenkins-hbase5:41787] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 16:14:21,351 INFO [RS:0;jenkins-hbase5:44777] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 16:14:21,351 INFO [RS:1;jenkins-hbase5:41787] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 16:14:21,355 DEBUG [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/WALs/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:21,356 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,44777,1689178459404] 2023-07-12 16:14:21,356 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,43171,1689178459521] 2023-07-12 16:14:21,356 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase5.apache.org,41787,1689178459474] 2023-07-12 16:14:21,357 DEBUG [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/WALs/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:21,397 DEBUG [RS:2;jenkins-hbase5:43171] zookeeper.ZKUtil(162): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:21,397 DEBUG [RS:1;jenkins-hbase5:41787] zookeeper.ZKUtil(162): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:21,397 DEBUG [RS:0;jenkins-hbase5:44777] zookeeper.ZKUtil(162): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:21,397 DEBUG [RS:1;jenkins-hbase5:41787] zookeeper.ZKUtil(162): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:21,398 DEBUG [RS:0;jenkins-hbase5:44777] zookeeper.ZKUtil(162): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:21,398 DEBUG [RS:2;jenkins-hbase5:43171] zookeeper.ZKUtil(162): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:21,398 DEBUG [RS:1;jenkins-hbase5:41787] zookeeper.ZKUtil(162): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:21,398 DEBUG [RS:0;jenkins-hbase5:44777] zookeeper.ZKUtil(162): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:21,399 DEBUG [RS:2;jenkins-hbase5:43171] zookeeper.ZKUtil(162): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:21,402 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:21,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 16:14:21,407 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/info 2023-07-12 16:14:21,408 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 16:14:21,409 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:21,409 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 16:14:21,412 DEBUG [RS:1;jenkins-hbase5:41787] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 16:14:21,412 DEBUG [RS:0;jenkins-hbase5:44777] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 16:14:21,412 DEBUG [RS:2;jenkins-hbase5:43171] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 16:14:21,413 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/rep_barrier 2023-07-12 16:14:21,414 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 16:14:21,414 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:21,415 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 16:14:21,417 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/table 2023-07-12 16:14:21,418 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 16:14:21,423 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:21,432 INFO [RS:2;jenkins-hbase5:43171] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 16:14:21,432 INFO [RS:1;jenkins-hbase5:41787] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 16:14:21,432 INFO [RS:0;jenkins-hbase5:44777] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 16:14:21,434 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740 2023-07-12 16:14:21,435 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740 2023-07-12 16:14:21,440 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 16:14:21,444 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 16:14:21,452 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:21,454 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64112192, jitterRate=-0.044653892517089844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 16:14:21,454 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 16:14:21,454 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 16:14:21,454 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 16:14:21,454 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 16:14:21,454 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 16:14:21,454 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 16:14:21,460 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 16:14:21,461 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 16:14:21,467 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 16:14:21,467 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 16:14:21,470 INFO [RS:2;jenkins-hbase5:43171] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 16:14:21,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 16:14:21,479 INFO [RS:1;jenkins-hbase5:41787] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 16:14:21,479 INFO [RS:0;jenkins-hbase5:44777] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 16:14:21,484 INFO [RS:0;jenkins-hbase5:44777] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 16:14:21,484 INFO [RS:2;jenkins-hbase5:43171] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 16:14:21,484 INFO [RS:0;jenkins-hbase5:44777] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,484 INFO [RS:1;jenkins-hbase5:41787] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 16:14:21,485 INFO [RS:2;jenkins-hbase5:43171] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,485 INFO [RS:1;jenkins-hbase5:41787] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,487 INFO [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 16:14:21,487 INFO [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 16:14:21,489 INFO [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 16:14:21,499 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 16:14:21,500 INFO [RS:2;jenkins-hbase5:43171] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,500 INFO [RS:1;jenkins-hbase5:41787] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,500 DEBUG [RS:2;jenkins-hbase5:43171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,500 DEBUG [RS:2;jenkins-hbase5:43171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,501 DEBUG [RS:2;jenkins-hbase5:43171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,501 DEBUG [RS:2;jenkins-hbase5:43171] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,501 DEBUG [RS:2;jenkins-hbase5:43171] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,501 DEBUG [RS:2;jenkins-hbase5:43171] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 16:14:21,502 DEBUG [RS:2;jenkins-hbase5:43171] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,502 DEBUG [RS:2;jenkins-hbase5:43171] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,502 DEBUG [RS:2;jenkins-hbase5:43171] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,501 INFO [RS:0;jenkins-hbase5:44777] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,502 DEBUG [RS:2;jenkins-hbase5:43171] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,502 DEBUG [RS:0;jenkins-hbase5:44777] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,501 DEBUG [RS:1;jenkins-hbase5:41787] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,502 DEBUG [RS:0;jenkins-hbase5:44777] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,503 DEBUG [RS:1;jenkins-hbase5:41787] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,503 DEBUG [RS:0;jenkins-hbase5:44777] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,503 DEBUG [RS:1;jenkins-hbase5:41787] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,503 DEBUG [RS:0;jenkins-hbase5:44777] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,503 DEBUG [RS:1;jenkins-hbase5:41787] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,503 DEBUG [RS:0;jenkins-hbase5:44777] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,503 DEBUG [RS:1;jenkins-hbase5:41787] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,503 DEBUG [RS:0;jenkins-hbase5:44777] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 16:14:21,503 DEBUG [RS:1;jenkins-hbase5:41787] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase5:0, corePoolSize=2, maxPoolSize=2 2023-07-12 16:14:21,503 DEBUG [RS:0;jenkins-hbase5:44777] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,503 DEBUG [RS:1;jenkins-hbase5:41787] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,503 DEBUG [RS:0;jenkins-hbase5:44777] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,504 DEBUG [RS:1;jenkins-hbase5:41787] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,504 DEBUG [RS:0;jenkins-hbase5:44777] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,504 DEBUG [RS:1;jenkins-hbase5:41787] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,504 DEBUG [RS:0;jenkins-hbase5:44777] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,504 DEBUG [RS:1;jenkins-hbase5:41787] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase5:0, corePoolSize=1, maxPoolSize=1 2023-07-12 16:14:21,503 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 16:14:21,513 INFO [RS:1;jenkins-hbase5:41787] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,513 INFO [RS:1;jenkins-hbase5:41787] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,514 INFO [RS:1;jenkins-hbase5:41787] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,549 INFO [RS:2;jenkins-hbase5:43171] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,549 INFO [RS:2;jenkins-hbase5:43171] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,549 INFO [RS:2;jenkins-hbase5:43171] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,563 INFO [RS:0;jenkins-hbase5:44777] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,563 INFO [RS:0;jenkins-hbase5:44777] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,563 INFO [RS:0;jenkins-hbase5:44777] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,585 INFO [RS:1;jenkins-hbase5:41787] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 16:14:21,586 INFO [RS:2;jenkins-hbase5:43171] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 16:14:21,589 INFO [RS:0;jenkins-hbase5:44777] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 16:14:21,590 INFO [RS:2;jenkins-hbase5:43171] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,43171,1689178459521-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,590 INFO [RS:0;jenkins-hbase5:44777] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,44777,1689178459404-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,590 INFO [RS:1;jenkins-hbase5:41787] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,41787,1689178459474-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:21,631 INFO [RS:0;jenkins-hbase5:44777] regionserver.Replication(203): jenkins-hbase5.apache.org,44777,1689178459404 started 2023-07-12 16:14:21,631 INFO [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,44777,1689178459404, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:44777, sessionid=0x101c5ec8d560001 2023-07-12 16:14:21,632 DEBUG [RS:0;jenkins-hbase5:44777] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 16:14:21,632 DEBUG [RS:0;jenkins-hbase5:44777] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:21,632 DEBUG [RS:0;jenkins-hbase5:44777] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,44777,1689178459404' 2023-07-12 16:14:21,632 DEBUG [RS:0;jenkins-hbase5:44777] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 16:14:21,633 DEBUG [RS:0;jenkins-hbase5:44777] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 16:14:21,635 DEBUG [RS:0;jenkins-hbase5:44777] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 16:14:21,635 DEBUG [RS:0;jenkins-hbase5:44777] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 16:14:21,635 DEBUG [RS:0;jenkins-hbase5:44777] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:21,635 DEBUG [RS:0;jenkins-hbase5:44777] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,44777,1689178459404' 2023-07-12 16:14:21,635 DEBUG [RS:0;jenkins-hbase5:44777] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:21,636 DEBUG [RS:0;jenkins-hbase5:44777] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:21,636 DEBUG [RS:0;jenkins-hbase5:44777] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 16:14:21,637 INFO [RS:0;jenkins-hbase5:44777] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 16:14:21,637 INFO [RS:0;jenkins-hbase5:44777] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 16:14:21,639 INFO [RS:2;jenkins-hbase5:43171] regionserver.Replication(203): jenkins-hbase5.apache.org,43171,1689178459521 started 2023-07-12 16:14:21,639 INFO [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,43171,1689178459521, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:43171, sessionid=0x101c5ec8d560003 2023-07-12 16:14:21,643 INFO [RS:1;jenkins-hbase5:41787] regionserver.Replication(203): jenkins-hbase5.apache.org,41787,1689178459474 started 2023-07-12 16:14:21,643 INFO [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(1637): Serving as jenkins-hbase5.apache.org,41787,1689178459474, RpcServer on jenkins-hbase5.apache.org/172.31.10.131:41787, sessionid=0x101c5ec8d560002 2023-07-12 16:14:21,644 DEBUG [RS:1;jenkins-hbase5:41787] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 16:14:21,644 DEBUG [RS:1;jenkins-hbase5:41787] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:21,645 DEBUG [RS:1;jenkins-hbase5:41787] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,41787,1689178459474' 2023-07-12 16:14:21,645 DEBUG [RS:2;jenkins-hbase5:43171] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 16:14:21,645 DEBUG [RS:2;jenkins-hbase5:43171] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:21,645 DEBUG [RS:1;jenkins-hbase5:41787] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 16:14:21,645 DEBUG [RS:2;jenkins-hbase5:43171] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,43171,1689178459521' 2023-07-12 16:14:21,646 DEBUG [RS:2;jenkins-hbase5:43171] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 16:14:21,646 DEBUG [RS:1;jenkins-hbase5:41787] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 16:14:21,646 DEBUG [RS:2;jenkins-hbase5:43171] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 16:14:21,648 DEBUG [RS:1;jenkins-hbase5:41787] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 16:14:21,648 DEBUG [RS:1;jenkins-hbase5:41787] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 16:14:21,648 DEBUG [RS:2;jenkins-hbase5:43171] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 16:14:21,648 DEBUG [RS:1;jenkins-hbase5:41787] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:21,649 DEBUG [RS:1;jenkins-hbase5:41787] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,41787,1689178459474' 2023-07-12 16:14:21,648 DEBUG [RS:2;jenkins-hbase5:43171] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 16:14:21,649 DEBUG [RS:2;jenkins-hbase5:43171] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:21,649 DEBUG [RS:2;jenkins-hbase5:43171] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase5.apache.org,43171,1689178459521' 2023-07-12 16:14:21,649 DEBUG [RS:2;jenkins-hbase5:43171] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:21,649 DEBUG [RS:1;jenkins-hbase5:41787] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:21,649 DEBUG [RS:2;jenkins-hbase5:43171] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:21,649 DEBUG [RS:1;jenkins-hbase5:41787] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:21,650 DEBUG [RS:2;jenkins-hbase5:43171] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 16:14:21,650 INFO [RS:2;jenkins-hbase5:43171] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 16:14:21,650 DEBUG [RS:1;jenkins-hbase5:41787] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 16:14:21,650 INFO [RS:2;jenkins-hbase5:43171] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 16:14:21,651 INFO [RS:1;jenkins-hbase5:41787] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 16:14:21,651 INFO [RS:1;jenkins-hbase5:41787] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 16:14:21,661 DEBUG [jenkins-hbase5:43373] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 16:14:21,666 DEBUG [jenkins-hbase5:43373] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:14:21,674 DEBUG [jenkins-hbase5:43373] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:14:21,675 DEBUG [jenkins-hbase5:43373] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:14:21,675 DEBUG [jenkins-hbase5:43373] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:14:21,675 DEBUG [jenkins-hbase5:43373] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:14:21,678 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,41787,1689178459474, state=OPENING 2023-07-12 16:14:21,689 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 16:14:21,691 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:21,692 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 16:14:21,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,41787,1689178459474}] 2023-07-12 16:14:21,751 INFO [RS:0;jenkins-hbase5:44777] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C44777%2C1689178459404, suffix=, logDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/WALs/jenkins-hbase5.apache.org,44777,1689178459404, archiveDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/oldWALs, maxLogs=32 2023-07-12 16:14:21,754 INFO [RS:1;jenkins-hbase5:41787] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C41787%2C1689178459474, suffix=, logDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/WALs/jenkins-hbase5.apache.org,41787,1689178459474, archiveDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/oldWALs, maxLogs=32 2023-07-12 16:14:21,757 INFO [RS:2;jenkins-hbase5:43171] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C43171%2C1689178459521, suffix=, logDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/WALs/jenkins-hbase5.apache.org,43171,1689178459521, archiveDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/oldWALs, maxLogs=32 2023-07-12 16:14:21,801 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36371,DS-aedfbf35-3ac8-4348-8dc8-5458df716a0f,DISK] 2023-07-12 16:14:21,806 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36371,DS-aedfbf35-3ac8-4348-8dc8-5458df716a0f,DISK] 2023-07-12 16:14:21,807 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42735,DS-9b773c85-7f52-4721-bd28-52b5f5206fa5,DISK] 2023-07-12 16:14:21,820 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43371,DS-0403c1e5-190c-4817-b6a6-b668e3823e49,DISK] 2023-07-12 16:14:21,820 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42735,DS-9b773c85-7f52-4721-bd28-52b5f5206fa5,DISK] 2023-07-12 16:14:21,820 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43371,DS-0403c1e5-190c-4817-b6a6-b668e3823e49,DISK] 2023-07-12 16:14:21,822 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42735,DS-9b773c85-7f52-4721-bd28-52b5f5206fa5,DISK] 2023-07-12 16:14:21,822 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43371,DS-0403c1e5-190c-4817-b6a6-b668e3823e49,DISK] 2023-07-12 16:14:21,827 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36371,DS-aedfbf35-3ac8-4348-8dc8-5458df716a0f,DISK] 2023-07-12 16:14:21,849 INFO [RS:0;jenkins-hbase5:44777] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/WALs/jenkins-hbase5.apache.org,44777,1689178459404/jenkins-hbase5.apache.org%2C44777%2C1689178459404.1689178461754 2023-07-12 16:14:21,850 DEBUG [RS:0;jenkins-hbase5:44777] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43371,DS-0403c1e5-190c-4817-b6a6-b668e3823e49,DISK], DatanodeInfoWithStorage[127.0.0.1:36371,DS-aedfbf35-3ac8-4348-8dc8-5458df716a0f,DISK], DatanodeInfoWithStorage[127.0.0.1:42735,DS-9b773c85-7f52-4721-bd28-52b5f5206fa5,DISK]] 2023-07-12 16:14:21,867 INFO [RS:2;jenkins-hbase5:43171] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/WALs/jenkins-hbase5.apache.org,43171,1689178459521/jenkins-hbase5.apache.org%2C43171%2C1689178459521.1689178461759 2023-07-12 16:14:21,867 INFO [RS:1;jenkins-hbase5:41787] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/WALs/jenkins-hbase5.apache.org,41787,1689178459474/jenkins-hbase5.apache.org%2C41787%2C1689178459474.1689178461759 2023-07-12 16:14:21,877 DEBUG [RS:1;jenkins-hbase5:41787] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42735,DS-9b773c85-7f52-4721-bd28-52b5f5206fa5,DISK], DatanodeInfoWithStorage[127.0.0.1:36371,DS-aedfbf35-3ac8-4348-8dc8-5458df716a0f,DISK], DatanodeInfoWithStorage[127.0.0.1:43371,DS-0403c1e5-190c-4817-b6a6-b668e3823e49,DISK]] 2023-07-12 16:14:21,877 DEBUG [RS:2;jenkins-hbase5:43171] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36371,DS-aedfbf35-3ac8-4348-8dc8-5458df716a0f,DISK], DatanodeInfoWithStorage[127.0.0.1:43371,DS-0403c1e5-190c-4817-b6a6-b668e3823e49,DISK], DatanodeInfoWithStorage[127.0.0.1:42735,DS-9b773c85-7f52-4721-bd28-52b5f5206fa5,DISK]] 2023-07-12 16:14:21,914 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:21,917 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 16:14:21,921 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:43044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 16:14:21,937 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 16:14:21,938 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 16:14:21,942 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase5.apache.org%2C41787%2C1689178459474.meta, suffix=.meta, logDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/WALs/jenkins-hbase5.apache.org,41787,1689178459474, archiveDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/oldWALs, maxLogs=32 2023-07-12 16:14:21,968 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43371,DS-0403c1e5-190c-4817-b6a6-b668e3823e49,DISK] 2023-07-12 16:14:21,971 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36371,DS-aedfbf35-3ac8-4348-8dc8-5458df716a0f,DISK] 2023-07-12 16:14:21,972 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42735,DS-9b773c85-7f52-4721-bd28-52b5f5206fa5,DISK] 2023-07-12 16:14:21,986 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/WALs/jenkins-hbase5.apache.org,41787,1689178459474/jenkins-hbase5.apache.org%2C41787%2C1689178459474.meta.1689178461943.meta 2023-07-12 16:14:21,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43371,DS-0403c1e5-190c-4817-b6a6-b668e3823e49,DISK], DatanodeInfoWithStorage[127.0.0.1:36371,DS-aedfbf35-3ac8-4348-8dc8-5458df716a0f,DISK], DatanodeInfoWithStorage[127.0.0.1:42735,DS-9b773c85-7f52-4721-bd28-52b5f5206fa5,DISK]] 2023-07-12 16:14:21,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 16:14:21,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-12 16:14:21,989 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:21,990 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 16:14:21,992 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 16:14:21,994 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 16:14:22,014 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 16:14:22,014 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:22,015 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 16:14:22,015 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 16:14:22,018 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 16:14:22,020 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/info 2023-07-12 16:14:22,020 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/info 2023-07-12 16:14:22,021 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 16:14:22,022 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:22,022 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 16:14:22,024 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/rep_barrier 2023-07-12 16:14:22,024 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/rep_barrier 2023-07-12 16:14:22,025 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 16:14:22,026 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:22,026 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 16:14:22,028 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/table 2023-07-12 16:14:22,028 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/table 2023-07-12 16:14:22,028 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 16:14:22,029 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:22,032 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740 2023-07-12 16:14:22,036 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740 2023-07-12 16:14:22,040 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 16:14:22,043 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 16:14:22,045 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68027377, jitterRate=0.013686910271644592}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 16:14:22,048 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 16:14:22,061 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689178461905 2023-07-12 16:14:22,082 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 16:14:22,083 INFO [RS_OPEN_META-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 16:14:22,084 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase5.apache.org,41787,1689178459474, state=OPEN 2023-07-12 16:14:22,087 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 16:14:22,087 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 16:14:22,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 16:14:22,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase5.apache.org,41787,1689178459474 in 390 msec 2023-07-12 16:14:22,100 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 16:14:22,100 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 615 msec 2023-07-12 16:14:22,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1080 sec 2023-07-12 16:14:22,123 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689178462123, completionTime=-1 2023-07-12 16:14:22,123 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 16:14:22,123 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 16:14:22,202 DEBUG [hconnection-0x77775a31-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:22,206 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:43054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:22,245 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 16:14:22,245 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689178522245 2023-07-12 16:14:22,245 INFO [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689178582245 2023-07-12 16:14:22,245 INFO [master/jenkins-hbase5:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 121 msec 2023-07-12 16:14:22,281 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,43373,1689178457825-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:22,281 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,43373,1689178457825-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:22,282 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,43373,1689178457825-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:22,284 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase5:43373, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:22,285 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 16:14:22,297 DEBUG [master/jenkins-hbase5:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 16:14:22,313 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 16:14:22,315 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 16:14:22,333 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 16:14:22,340 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:14:22,346 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:14:22,374 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/hbase/namespace/e92498b243419952ff4283dbf667589c 2023-07-12 16:14:22,377 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/hbase/namespace/e92498b243419952ff4283dbf667589c empty. 2023-07-12 16:14:22,378 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/hbase/namespace/e92498b243419952ff4283dbf667589c 2023-07-12 16:14:22,378 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 16:14:22,431 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 16:14:22,434 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e92498b243419952ff4283dbf667589c, NAME => 'hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:14:22,465 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:22,465 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e92498b243419952ff4283dbf667589c, disabling compactions & flushes 2023-07-12 16:14:22,465 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. 2023-07-12 16:14:22,465 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. 2023-07-12 16:14:22,465 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. after waiting 0 ms 2023-07-12 16:14:22,465 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. 2023-07-12 16:14:22,465 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. 2023-07-12 16:14:22,465 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e92498b243419952ff4283dbf667589c: 2023-07-12 16:14:22,470 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:14:22,490 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689178462474"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178462474"}]},"ts":"1689178462474"} 2023-07-12 16:14:22,524 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 16:14:22,527 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:14:22,533 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178462527"}]},"ts":"1689178462527"} 2023-07-12 16:14:22,538 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 16:14:22,544 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:14:22,545 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:14:22,545 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:14:22,545 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:14:22,545 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:14:22,549 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e92498b243419952ff4283dbf667589c, ASSIGN}] 2023-07-12 16:14:22,553 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e92498b243419952ff4283dbf667589c, ASSIGN 2023-07-12 16:14:22,560 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e92498b243419952ff4283dbf667589c, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,43171,1689178459521; forceNewPlan=false, retain=false 2023-07-12 16:14:22,713 INFO [jenkins-hbase5:43373] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 16:14:22,714 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e92498b243419952ff4283dbf667589c, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:22,715 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689178462714"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178462714"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178462714"}]},"ts":"1689178462714"} 2023-07-12 16:14:22,720 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e92498b243419952ff4283dbf667589c, server=jenkins-hbase5.apache.org,43171,1689178459521}] 2023-07-12 16:14:22,876 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:22,876 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 16:14:22,879 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:48542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 16:14:22,885 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. 2023-07-12 16:14:22,885 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e92498b243419952ff4283dbf667589c, NAME => 'hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c.', STARTKEY => '', ENDKEY => ''} 2023-07-12 16:14:22,886 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. service=AccessControlService 2023-07-12 16:14:22,887 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:22,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e92498b243419952ff4283dbf667589c 2023-07-12 16:14:22,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:22,888 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for e92498b243419952ff4283dbf667589c 2023-07-12 16:14:22,888 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for e92498b243419952ff4283dbf667589c 2023-07-12 16:14:22,891 INFO [StoreOpener-e92498b243419952ff4283dbf667589c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e92498b243419952ff4283dbf667589c 2023-07-12 16:14:22,893 DEBUG [StoreOpener-e92498b243419952ff4283dbf667589c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/namespace/e92498b243419952ff4283dbf667589c/info 2023-07-12 16:14:22,894 DEBUG [StoreOpener-e92498b243419952ff4283dbf667589c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/namespace/e92498b243419952ff4283dbf667589c/info 2023-07-12 16:14:22,894 INFO [StoreOpener-e92498b243419952ff4283dbf667589c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e92498b243419952ff4283dbf667589c columnFamilyName info 2023-07-12 16:14:22,895 INFO [StoreOpener-e92498b243419952ff4283dbf667589c-1] regionserver.HStore(310): Store=e92498b243419952ff4283dbf667589c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:22,897 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/namespace/e92498b243419952ff4283dbf667589c 2023-07-12 16:14:22,898 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/namespace/e92498b243419952ff4283dbf667589c 2023-07-12 16:14:22,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for e92498b243419952ff4283dbf667589c 2023-07-12 16:14:22,909 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/namespace/e92498b243419952ff4283dbf667589c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:22,910 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened e92498b243419952ff4283dbf667589c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70625499, jitterRate=0.05240194499492645}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:22,910 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for e92498b243419952ff4283dbf667589c: 2023-07-12 16:14:22,912 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c., pid=6, masterSystemTime=1689178462876 2023-07-12 16:14:22,918 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. 2023-07-12 16:14:22,918 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. 2023-07-12 16:14:22,920 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e92498b243419952ff4283dbf667589c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:22,920 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689178462919"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178462919"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178462919"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178462919"}]},"ts":"1689178462919"} 2023-07-12 16:14:22,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 16:14:22,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e92498b243419952ff4283dbf667589c, server=jenkins-hbase5.apache.org,43171,1689178459521 in 205 msec 2023-07-12 16:14:22,937 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 16:14:22,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e92498b243419952ff4283dbf667589c, ASSIGN in 384 msec 2023-07-12 16:14:22,940 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:14:22,941 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178462940"}]},"ts":"1689178462940"} 2023-07-12 16:14:22,943 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 16:14:22,947 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:14:22,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 631 msec 2023-07-12 16:14:23,036 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 16:14:23,038 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 16:14:23,038 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:23,061 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:23,063 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:48552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:23,079 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 16:14:23,106 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 16:14:23,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 43 msec 2023-07-12 16:14:23,124 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 16:14:23,135 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 16:14:23,141 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-07-12 16:14:23,152 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 16:14:23,155 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 16:14:23,156 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.557sec 2023-07-12 16:14:23,160 INFO [master/jenkins-hbase5:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 16:14:23,162 INFO [master/jenkins-hbase5:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 16:14:23,162 INFO [master/jenkins-hbase5:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 16:14:23,164 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,43373,1689178457825-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 16:14:23,165 INFO [master/jenkins-hbase5:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase5.apache.org,43373,1689178457825-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 16:14:23,186 DEBUG [Listener at localhost/36467] zookeeper.ReadOnlyZKClient(139): Connect 0x52f9184c to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:23,194 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 16:14:23,198 DEBUG [Listener at localhost/36467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@aad9b51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:23,200 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-12 16:14:23,205 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:14:23,209 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:14:23,212 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/hbase/acl/a749775b4a9fe382b9fe214518989c64 2023-07-12 16:14:23,213 INFO [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-12 16:14:23,213 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/hbase/acl/a749775b4a9fe382b9fe214518989c64 empty. 2023-07-12 16:14:23,216 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/hbase/acl/a749775b4a9fe382b9fe214518989c64 2023-07-12 16:14:23,216 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-12 16:14:23,225 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 16:14:23,225 DEBUG [hconnection-0x53835f75-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:23,247 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:43064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:23,257 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase5.apache.org,43373,1689178457825 2023-07-12 16:14:23,257 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-12 16:14:23,257 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/test.cache.data in system properties and HBase conf 2023-07-12 16:14:23,257 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 16:14:23,257 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop.log.dir in system properties and HBase conf 2023-07-12 16:14:23,257 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 16:14:23,257 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 16:14:23,257 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 16:14:23,258 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 16:14:23,258 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 16:14:23,258 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 16:14:23,258 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 16:14:23,258 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 16:14:23,258 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 16:14:23,258 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 16:14:23,258 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 16:14:23,258 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 16:14:23,258 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/nfs.dump.dir in system properties and HBase conf 2023-07-12 16:14:23,258 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/java.io.tmpdir in system properties and HBase conf 2023-07-12 16:14:23,259 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 16:14:23,259 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 16:14:23,259 INFO [Listener at localhost/36467] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-12 16:14:23,274 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-12 16:14:23,280 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => a749775b4a9fe382b9fe214518989c64, NAME => 'hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:14:23,309 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:23,310 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing a749775b4a9fe382b9fe214518989c64, disabling compactions & flushes 2023-07-12 16:14:23,310 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. 2023-07-12 16:14:23,310 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. 2023-07-12 16:14:23,310 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. after waiting 0 ms 2023-07-12 16:14:23,310 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. 2023-07-12 16:14:23,310 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. 2023-07-12 16:14:23,310 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for a749775b4a9fe382b9fe214518989c64: 2023-07-12 16:14:23,316 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:14:23,321 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689178463320"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178463320"}]},"ts":"1689178463320"} 2023-07-12 16:14:23,328 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 16:14:23,329 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 16:14:23,330 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:14:23,331 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178463330"}]},"ts":"1689178463330"} 2023-07-12 16:14:23,334 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-12 16:14:23,338 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:14:23,347 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:14:23,347 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:14:23,347 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:14:23,347 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:14:23,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a749775b4a9fe382b9fe214518989c64, ASSIGN}] 2023-07-12 16:14:23,353 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a749775b4a9fe382b9fe214518989c64, ASSIGN 2023-07-12 16:14:23,358 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=a749775b4a9fe382b9fe214518989c64, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44777,1689178459404; forceNewPlan=false, retain=false 2023-07-12 16:14:23,508 INFO [jenkins-hbase5:43373] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 16:14:23,509 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a749775b4a9fe382b9fe214518989c64, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:23,510 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689178463509"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178463509"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178463509"}]},"ts":"1689178463509"} 2023-07-12 16:14:23,514 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure a749775b4a9fe382b9fe214518989c64, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:14:23,535 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 16:14:23,712 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:23,713 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 16:14:23,722 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:49004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 16:14:23,733 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. 2023-07-12 16:14:23,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a749775b4a9fe382b9fe214518989c64, NAME => 'hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64.', STARTKEY => '', ENDKEY => ''} 2023-07-12 16:14:23,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. service=AccessControlService 2023-07-12 16:14:23,734 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:23,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl a749775b4a9fe382b9fe214518989c64 2023-07-12 16:14:23,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:23,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for a749775b4a9fe382b9fe214518989c64 2023-07-12 16:14:23,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for a749775b4a9fe382b9fe214518989c64 2023-07-12 16:14:23,737 INFO [StoreOpener-a749775b4a9fe382b9fe214518989c64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region a749775b4a9fe382b9fe214518989c64 2023-07-12 16:14:23,740 DEBUG [StoreOpener-a749775b4a9fe382b9fe214518989c64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/acl/a749775b4a9fe382b9fe214518989c64/l 2023-07-12 16:14:23,740 DEBUG [StoreOpener-a749775b4a9fe382b9fe214518989c64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/acl/a749775b4a9fe382b9fe214518989c64/l 2023-07-12 16:14:23,740 INFO [StoreOpener-a749775b4a9fe382b9fe214518989c64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a749775b4a9fe382b9fe214518989c64 columnFamilyName l 2023-07-12 16:14:23,743 INFO [StoreOpener-a749775b4a9fe382b9fe214518989c64-1] regionserver.HStore(310): Store=a749775b4a9fe382b9fe214518989c64/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:23,745 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/acl/a749775b4a9fe382b9fe214518989c64 2023-07-12 16:14:23,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/acl/a749775b4a9fe382b9fe214518989c64 2023-07-12 16:14:23,752 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for a749775b4a9fe382b9fe214518989c64 2023-07-12 16:14:23,759 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/acl/a749775b4a9fe382b9fe214518989c64/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:23,760 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened a749775b4a9fe382b9fe214518989c64; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66920090, jitterRate=-0.0028129518032073975}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:23,761 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for a749775b4a9fe382b9fe214518989c64: 2023-07-12 16:14:23,763 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64., pid=11, masterSystemTime=1689178463712 2023-07-12 16:14:23,769 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. 2023-07-12 16:14:23,770 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. 2023-07-12 16:14:23,771 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a749775b4a9fe382b9fe214518989c64, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:23,772 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689178463771"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178463771"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178463771"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178463771"}]},"ts":"1689178463771"} 2023-07-12 16:14:23,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 16:14:23,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure a749775b4a9fe382b9fe214518989c64, server=jenkins-hbase5.apache.org,44777,1689178459404 in 262 msec 2023-07-12 16:14:23,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 16:14:23,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=a749775b4a9fe382b9fe214518989c64, ASSIGN in 436 msec 2023-07-12 16:14:23,792 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:14:23,793 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178463792"}]},"ts":"1689178463792"} 2023-07-12 16:14:23,796 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-12 16:14:23,800 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:14:23,804 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 605 msec 2023-07-12 16:14:23,836 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 16:14:23,836 INFO [master/jenkins-hbase5:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-12 16:14:23,849 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 16:14:24,779 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:25,152 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:25,159 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/java.io.tmpdir/Jetty_jenkins.hbase5_apache_org_32797_jobhistory____.rrlk0y/webapp 2023-07-12 16:14:25,342 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-12 16:14:25,343 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-12 16:14:25,343 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 16:14:25,346 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 16:14:25,438 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:25,813 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:26,213 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-12 16:14:26,299 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:32797 2023-07-12 16:14:27,575 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:14:27,870 WARN [Listener at jenkins-hbase5.apache.org/40841] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:27,906 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-12 16:14:27,908 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 16:14:27,910 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 16:14:28,019 WARN [Listener at jenkins-hbase5.apache.org/40841] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 16:14:28,020 INFO [Listener at jenkins-hbase5.apache.org/40841] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:28,030 INFO [Listener at jenkins-hbase5.apache.org/40841] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/java.io.tmpdir/Jetty_jenkins.hbase5_apache_org_38373_cluster____.8i0esl/webapp 2023-07-12 16:14:28,063 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:14:28,064 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-12 16:14:28,065 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:14:28,065 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-12 16:14:28,065 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 16:14:28,065 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-12 16:14:28,066 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:14:28,066 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-12 16:14:28,066 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 16:14:28,066 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 16:14:28,106 INFO [Listener at jenkins-hbase5.apache.org/40841] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 16:14:28,107 INFO [Listener at jenkins-hbase5.apache.org/40841] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-12 16:14:28,107 INFO [Listener at jenkins-hbase5.apache.org/40841] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 16:14:28,107 INFO [Listener at jenkins-hbase5.apache.org/40841] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 16:14:28,116 INFO [Listener at jenkins-hbase5.apache.org/40841] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:28,353 INFO [Listener at jenkins-hbase5.apache.org/40841] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:28,486 INFO [Listener at jenkins-hbase5.apache.org/40841] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:28,500 INFO [Listener at jenkins-hbase5.apache.org/40841] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:38373 2023-07-12 16:14:29,027 WARN [Listener at jenkins-hbase5.apache.org/44359] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:29,057 WARN [Listener at jenkins-hbase5.apache.org/44359] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 16:14:29,057 INFO [Listener at jenkins-hbase5.apache.org/44359] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:29,065 INFO [Listener at jenkins-hbase5.apache.org/44359] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/java.io.tmpdir/Jetty_jenkins.hbase5_apache_org_42709_node____rb34v/webapp 2023-07-12 16:14:29,118 INFO [Listener at jenkins-hbase5.apache.org/44359] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 16:14:29,118 INFO [Listener at jenkins-hbase5.apache.org/44359] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 16:14:29,118 INFO [Listener at jenkins-hbase5.apache.org/44359] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 16:14:29,118 INFO [Listener at jenkins-hbase5.apache.org/44359] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 16:14:29,127 INFO [Listener at jenkins-hbase5.apache.org/44359] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:29,150 INFO [Listener at jenkins-hbase5.apache.org/44359] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:29,258 INFO [Listener at jenkins-hbase5.apache.org/44359] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:29,279 INFO [Listener at jenkins-hbase5.apache.org/44359] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:42709 2023-07-12 16:14:29,623 WARN [Listener at jenkins-hbase5.apache.org/37867] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 16:14:29,632 WARN [Listener at jenkins-hbase5.apache.org/37867] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 16:14:29,633 INFO [Listener at jenkins-hbase5.apache.org/37867] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 16:14:29,647 INFO [Listener at jenkins-hbase5.apache.org/37867] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/java.io.tmpdir/Jetty_jenkins.hbase5_apache_org_40073_node____5yq4j1/webapp 2023-07-12 16:14:29,724 INFO [Listener at jenkins-hbase5.apache.org/37867] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 16:14:29,724 INFO [Listener at jenkins-hbase5.apache.org/37867] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 16:14:29,724 INFO [Listener at jenkins-hbase5.apache.org/37867] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 16:14:29,724 INFO [Listener at jenkins-hbase5.apache.org/37867] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 16:14:29,736 INFO [Listener at jenkins-hbase5.apache.org/37867] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:29,758 INFO [Listener at jenkins-hbase5.apache.org/37867] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:29,850 INFO [Listener at jenkins-hbase5.apache.org/37867] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 16:14:29,857 INFO [Listener at jenkins-hbase5.apache.org/37867] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:40073 2023-07-12 16:14:29,884 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-12 16:14:29,885 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:14:29,958 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=259, ProcessCount=163, AvailableMemoryMB=6208 2023-07-12 16:14:29,958 WARN [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-07-12 16:14:29,975 DEBUG [Listener at jenkins-hbase5.apache.org/37867] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 16:14:29,982 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:51516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 16:14:29,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 16:14:29,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:30,003 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:14:30,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-12 16:14:30,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 16:14:30,007 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:14:30,020 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50 2023-07-12 16:14:30,020 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13 2023-07-12 16:14:30,023 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50 empty. 2023-07-12 16:14:30,023 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13 empty. 2023-07-12 16:14:30,025 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50 2023-07-12 16:14:30,025 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13 2023-07-12 16:14:30,026 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 16:14:30,073 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-12 16:14:30,075 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => d95f71e6368d148446028356d233dc13, NAME => 'testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:14:30,075 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 22511d5e036ddb82c23bbeb49f2e1d50, NAME => 'testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:14:30,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 16:14:30,136 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:30,137 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 22511d5e036ddb82c23bbeb49f2e1d50, disabling compactions & flushes 2023-07-12 16:14:30,137 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:30,137 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:30,138 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. after waiting 0 ms 2023-07-12 16:14:30,138 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:30,138 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:30,138 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 22511d5e036ddb82c23bbeb49f2e1d50: 2023-07-12 16:14:30,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 16:14:30,531 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:30,531 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing d95f71e6368d148446028356d233dc13, disabling compactions & flushes 2023-07-12 16:14:30,531 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:30,531 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:30,531 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. after waiting 0 ms 2023-07-12 16:14:30,531 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:30,531 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:30,531 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for d95f71e6368d148446028356d233dc13: 2023-07-12 16:14:30,535 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:14:30,537 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178470536"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178470536"}]},"ts":"1689178470536"} 2023-07-12 16:14:30,537 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178470536"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178470536"}]},"ts":"1689178470536"} 2023-07-12 16:14:30,592 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:14:30,594 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:14:30,594 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178470594"}]},"ts":"1689178470594"} 2023-07-12 16:14:30,597 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-12 16:14:30,605 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:14:30,608 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:14:30,608 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:14:30,608 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:14:30,608 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:14:30,608 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=22511d5e036ddb82c23bbeb49f2e1d50, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d95f71e6368d148446028356d233dc13, ASSIGN}] 2023-07-12 16:14:30,614 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=22511d5e036ddb82c23bbeb49f2e1d50, ASSIGN 2023-07-12 16:14:30,614 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d95f71e6368d148446028356d233dc13, ASSIGN 2023-07-12 16:14:30,616 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d95f71e6368d148446028356d233dc13, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44777,1689178459404; forceNewPlan=false, retain=false 2023-07-12 16:14:30,616 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=22511d5e036ddb82c23bbeb49f2e1d50, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,43171,1689178459521; forceNewPlan=false, retain=false 2023-07-12 16:14:30,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 16:14:30,766 INFO [jenkins-hbase5:43373] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:14:30,769 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d95f71e6368d148446028356d233dc13, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:30,769 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=22511d5e036ddb82c23bbeb49f2e1d50, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:30,769 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178470769"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178470769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178470769"}]},"ts":"1689178470769"} 2023-07-12 16:14:30,769 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178470769"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178470769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178470769"}]},"ts":"1689178470769"} 2023-07-12 16:14:30,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure d95f71e6368d148446028356d233dc13, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:14:30,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 22511d5e036ddb82c23bbeb49f2e1d50, server=jenkins-hbase5.apache.org,43171,1689178459521}] 2023-07-12 16:14:30,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:30,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d95f71e6368d148446028356d233dc13, NAME => 'testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 16:14:30,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. service=AccessControlService 2023-07-12 16:14:30,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:30,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName d95f71e6368d148446028356d233dc13 2023-07-12 16:14:30,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:30,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for d95f71e6368d148446028356d233dc13 2023-07-12 16:14:30,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for d95f71e6368d148446028356d233dc13 2023-07-12 16:14:30,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:30,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 22511d5e036ddb82c23bbeb49f2e1d50, NAME => 'testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 16:14:30,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. service=AccessControlService 2023-07-12 16:14:30,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:30,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 22511d5e036ddb82c23bbeb49f2e1d50 2023-07-12 16:14:30,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:30,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 22511d5e036ddb82c23bbeb49f2e1d50 2023-07-12 16:14:30,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 22511d5e036ddb82c23bbeb49f2e1d50 2023-07-12 16:14:30,936 INFO [StoreOpener-d95f71e6368d148446028356d233dc13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d95f71e6368d148446028356d233dc13 2023-07-12 16:14:30,936 INFO [StoreOpener-22511d5e036ddb82c23bbeb49f2e1d50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 22511d5e036ddb82c23bbeb49f2e1d50 2023-07-12 16:14:30,938 DEBUG [StoreOpener-d95f71e6368d148446028356d233dc13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/cf 2023-07-12 16:14:30,938 DEBUG [StoreOpener-d95f71e6368d148446028356d233dc13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/cf 2023-07-12 16:14:30,938 DEBUG [StoreOpener-22511d5e036ddb82c23bbeb49f2e1d50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/cf 2023-07-12 16:14:30,938 DEBUG [StoreOpener-22511d5e036ddb82c23bbeb49f2e1d50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/cf 2023-07-12 16:14:30,942 INFO [StoreOpener-22511d5e036ddb82c23bbeb49f2e1d50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22511d5e036ddb82c23bbeb49f2e1d50 columnFamilyName cf 2023-07-12 16:14:30,942 INFO [StoreOpener-d95f71e6368d148446028356d233dc13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d95f71e6368d148446028356d233dc13 columnFamilyName cf 2023-07-12 16:14:30,945 INFO [StoreOpener-22511d5e036ddb82c23bbeb49f2e1d50-1] regionserver.HStore(310): Store=22511d5e036ddb82c23bbeb49f2e1d50/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:30,945 INFO [StoreOpener-d95f71e6368d148446028356d233dc13-1] regionserver.HStore(310): Store=d95f71e6368d148446028356d233dc13/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:30,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50 2023-07-12 16:14:30,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13 2023-07-12 16:14:30,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50 2023-07-12 16:14:30,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13 2023-07-12 16:14:30,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 22511d5e036ddb82c23bbeb49f2e1d50 2023-07-12 16:14:30,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for d95f71e6368d148446028356d233dc13 2023-07-12 16:14:30,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:30,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 22511d5e036ddb82c23bbeb49f2e1d50; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74745118, jitterRate=0.11378905177116394}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:30,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 22511d5e036ddb82c23bbeb49f2e1d50: 2023-07-12 16:14:30,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:30,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened d95f71e6368d148446028356d233dc13; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70993056, jitterRate=0.057878971099853516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:30,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for d95f71e6368d148446028356d233dc13: 2023-07-12 16:14:30,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50., pid=16, masterSystemTime=1689178470926 2023-07-12 16:14:30,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13., pid=15, masterSystemTime=1689178470924 2023-07-12 16:14:30,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:30,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:30,973 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=22511d5e036ddb82c23bbeb49f2e1d50, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:30,974 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178470973"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178470973"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178470973"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178470973"}]},"ts":"1689178470973"} 2023-07-12 16:14:30,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:30,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:30,975 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d95f71e6368d148446028356d233dc13, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:30,979 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178470975"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178470975"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178470975"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178470975"}]},"ts":"1689178470975"} 2023-07-12 16:14:30,984 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-12 16:14:30,985 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 22511d5e036ddb82c23bbeb49f2e1d50, server=jenkins-hbase5.apache.org,43171,1689178459521 in 207 msec 2023-07-12 16:14:30,987 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-12 16:14:30,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure d95f71e6368d148446028356d233dc13, server=jenkins-hbase5.apache.org,44777,1689178459404 in 210 msec 2023-07-12 16:14:30,990 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=22511d5e036ddb82c23bbeb49f2e1d50, ASSIGN in 377 msec 2023-07-12 16:14:30,992 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-12 16:14:30,992 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d95f71e6368d148446028356d233dc13, ASSIGN in 381 msec 2023-07-12 16:14:30,993 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:14:30,994 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178470993"}]},"ts":"1689178470993"} 2023-07-12 16:14:30,996 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-12 16:14:30,999 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:14:31,005 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-12 16:14:31,012 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:31,017 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:31,023 DEBUG [hconnection-0x61cb458d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:31,027 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-12 16:14:31,036 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 16:14:31,071 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:31,072 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:31,072 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:31,072 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:31,072 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:14:31,081 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:31,081 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:31,081 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:31,081 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:31,085 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.0890 sec 2023-07-12 16:14:31,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 16:14:31,123 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-12 16:14:31,127 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 16:14:31,128 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:31,130 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:14:31,153 DEBUG [hconnection-0x53835f75-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:31,159 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:56312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:31,166 DEBUG [hconnection-0x53835f75-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:31,169 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:31,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 16:14:31,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178471185 (current time:1689178471185). 2023-07-12 16:14:31,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:14:31,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x2c62ff3d to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:31,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@929a6ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:31,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:31,200 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:31,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c62ff3d to 127.0.0.1:53717 2023-07-12 16:14:31,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:31,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x3c862122 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:31,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2072c9d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:31,218 DEBUG [hconnection-0x7c7105-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:31,220 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:31,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:31,228 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:31,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c862122 to 127.0.0.1:53717 2023-07-12 16:14:31,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:31,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 16:14:31,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:14:31,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 16:14:31,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 16:14:31,282 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 16:14:31,283 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689179071283 2023-07-12 16:14:31,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 16:14:31,284 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 16:14:31,290 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:14:31,291 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:14:31,293 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 16:14:31,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 16:14:31,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 25 msec 2023-07-12 16:14:31,298 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 16:14:31,300 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689179071300 2023-07-12 16:14:31,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,334 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-12 16:14:31,334 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:31,335 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 16:14:31,335 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 16:14:31,336 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,336 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,342 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:31,342 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:31,342 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:31,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:31,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:31,343 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:31,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,344 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,344 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,344 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,345 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:14:31,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 16:14:31,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,346 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 16:14:31,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 16:14:31,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,348 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 16:14:31,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 16:14:31,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,348 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 16:14:31,350 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,350 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,351 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 16:14:31,352 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:31,353 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 16:14:31,353 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 16:14:31,353 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 16:14:31,353 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 16:14:31,353 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:31,354 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 16:14:31,354 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 16:14:31,354 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:31,354 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 16:14:31,355 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 16:14:31,355 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 16:14:31,355 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 16:14:31,355 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 16:14:31,357 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,358 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:31,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:31,359 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,359 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,359 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:31,359 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:31,359 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,360 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,360 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:31,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:31,360 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,360 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:31,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:31,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:31,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 16:14:31,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a6dedb5[Count = 1] remaining members to acquire global barrier 2023-07-12 16:14:31,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:31,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:31,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:31,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:31,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:31,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:31,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 16:14:31,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a6dedb5[Count = 0] remaining members to acquire global barrier 2023-07-12 16:14:31,371 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 16:14:31,371 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,374 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 16:14:31,375 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,375 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 16:14:31,375 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,41787,1689178459474' in zk 2023-07-12 16:14:31,375 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 16:14:31,376 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,376 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:14:31,380 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:31,380 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:31,381 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 16:14:31,381 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:31,381 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 16:14:31,381 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:31,382 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 16:14:31,382 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. started... 2023-07-12 16:14:31,391 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:31,412 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:31,415 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:31,420 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:31,420 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. started... 2023-07-12 16:14:31,422 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 22511d5e036ddb82c23bbeb49f2e1d50: 2023-07-12 16:14:31,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 16:14:31,423 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:31,422 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d95f71e6368d148446028356d233dc13: 2023-07-12 16:14:31,425 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:14:31,425 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,431 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:31,431 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:31,436 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:14:31,437 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:14:31,483 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. completed. 2023-07-12 16:14:31,483 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:31,485 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:31,485 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:31,486 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,486 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 16:14:31,486 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,44777,1689178459404' in zk 2023-07-12 16:14:31,489 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,489 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 16:14:31,489 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:31,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:31,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:31,489 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 16:14:31,490 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. completed. 2023-07-12 16:14:31,490 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:31,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:31,491 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:31,491 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:31,491 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,491 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 16:14:31,491 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,43171,1689178459521' in zk 2023-07-12 16:14:31,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:31,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,493 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 16:14:31,493 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,493 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:31,493 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 16:14:31,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:31,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:31,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:31,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase5.apache.org,44777,1689178459404': 2023-07-12 16:14:31,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 16:14:31,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:31,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:31,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:31,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:31,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:31,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:31,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:31,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase5.apache.org,43171,1689178459521': 2023-07-12 16:14:31,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 16:14:31,503 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-12 16:14:31,503 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:14:31,503 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:14:31,503 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,503 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:14:31,507 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,507 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,507 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:31,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,507 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,507 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:31,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,507 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:31,507 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:31,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:31,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:31,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:31,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:31,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,509 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:31,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:31,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:31,509 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:31,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,510 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:31,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:31,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:31,513 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,513 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:31,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,514 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:31,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,529 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:31,529 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:31,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:31,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:31,529 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:31,529 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:31,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:31,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:31,529 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,529 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,529 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:31,529 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,530 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,530 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:31,530 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:31,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:31,530 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:31,530 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:31,530 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,530 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,531 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:31,531 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,531 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 16:14:31,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:31,532 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:31,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:31,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 16:14:31,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:31,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:31,532 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:31,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:31,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:31,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 16:14:31,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,628 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:31,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 16:14:31,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:31,630 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 16:14:31,664 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 16:14:31,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,665 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:31,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689178471285Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689178471555 (+270 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689178471555Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689178471555Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689178471570 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689178471605 (+35 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689178471664 (+59 ms) 2023-07-12 16:14:31,666 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 16:14:31,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 380 msec 2023-07-12 16:14:31,930 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:31,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 16:14:31,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:14:31,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43171] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:14:31,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44777] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:14:31,957 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 16:14:31,957 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:31,958 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:14:31,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 16:14:31,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178471974 (current time:1689178471974). 2023-07-12 16:14:31,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:14:31,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x1de63b48 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:31,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68ef3ee4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:31,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:31,987 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:31,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1de63b48 to 127.0.0.1:53717 2023-07-12 16:14:31,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:31,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x7f4c75c2 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:32,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@535c2d18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:32,002 DEBUG [hconnection-0x42d53189-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:32,005 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:37332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:32,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:32,013 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:40998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:32,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f4c75c2 to 127.0.0.1:53717 2023-07-12 16:14:32,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:32,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 16:14:32,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:14:32,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 16:14:32,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 16:14:32,021 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 16:14:32,023 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689179072023 2023-07-12 16:14:32,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 16:14:32,023 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 16:14:32,025 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:14:32,025 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:14:32,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 16:14:32,026 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 16:14:32,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-12 16:14:32,029 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 16:14:32,031 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689179072031 2023-07-12 16:14:32,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-12 16:14:32,058 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-12 16:14:32,058 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:32,060 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 16:14:32,060 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 16:14:32,061 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,061 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,063 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:32,063 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:32,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:32,064 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,064 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:32,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:32,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:32,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:32,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:32,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:32,064 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,064 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,065 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,065 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:14:32,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 16:14:32,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 16:14:32,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 16:14:32,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 16:14:32,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 16:14:32,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 16:14:32,067 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 16:14:32,067 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:32,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 16:14:32,067 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 16:14:32,067 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 16:14:32,068 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:32,068 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 16:14:32,069 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 16:14:32,069 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 16:14:32,069 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 16:14:32,069 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 16:14:32,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 16:14:32,069 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 16:14:32,070 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 16:14:32,070 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:32,071 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 16:14:32,071 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 16:14:32,071 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 16:14:32,075 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,075 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:32,075 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,076 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,076 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:32,076 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,077 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:32,076 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,077 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:32,077 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,077 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:32,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 16:14:32,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f67d5d2[Count = 1] remaining members to acquire global barrier 2023-07-12 16:14:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:32,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:32,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:32,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 16:14:32,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f67d5d2[Count = 0] remaining members to acquire global barrier 2023-07-12 16:14:32,083 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 16:14:32,083 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,089 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,089 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,089 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,089 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,090 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 16:14:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,090 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 16:14:32,090 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 16:14:32,090 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,090 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:32,090 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:32,090 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 16:14:32,090 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. started... 2023-07-12 16:14:32,090 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,41787,1689178459474' in zk 2023-07-12 16:14:32,090 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:32,090 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 22511d5e036ddb82c23bbeb49f2e1d50 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 16:14:32,090 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:14:32,095 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:32,097 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:32,097 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 16:14:32,097 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:32,097 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 16:14:32,099 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:32,099 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. started... 2023-07-12 16:14:32,099 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d95f71e6368d148446028356d233dc13 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 16:14:32,125 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:32,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 16:14:32,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:32,127 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:14:32,273 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071250bcd2c70e2b4cdfbf5dcc2cdee55fe6 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071250bcd2c70e2b4cdfbf5dcc2cdee55fe6 2023-07-12 16:14:32,273 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071226e4a5975af9442f97eaa9e32d01f1be to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071226e4a5975af9442f97eaa9e32d01f1be 2023-07-12 16:14:32,318 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/.tmp/cf/4b59056500034e18a28b839b79b275a2 2023-07-12 16:14:32,325 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/.tmp/cf/7d8560cf7d15435a86bce9f56a5d779c 2023-07-12 16:14:32,327 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:32,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 16:14:32,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:32,330 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 16:14:32,338 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/.tmp/cf/4b59056500034e18a28b839b79b275a2 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/cf/4b59056500034e18a28b839b79b275a2 2023-07-12 16:14:32,341 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/.tmp/cf/7d8560cf7d15435a86bce9f56a5d779c as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/cf/7d8560cf7d15435a86bce9f56a5d779c 2023-07-12 16:14:32,349 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/cf/4b59056500034e18a28b839b79b275a2, entries=3, sequenceid=6, filesize=5.4 K 2023-07-12 16:14:32,351 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/cf/7d8560cf7d15435a86bce9f56a5d779c, entries=47, sequenceid=6, filesize=12.8 K 2023-07-12 16:14:32,358 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for d95f71e6368d148446028356d233dc13 in 259ms, sequenceid=6, compaction requested=false 2023-07-12 16:14:32,358 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 22511d5e036ddb82c23bbeb49f2e1d50 in 268ms, sequenceid=6, compaction requested=false 2023-07-12 16:14:32,359 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 16:14:32,359 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 16:14:32,361 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d95f71e6368d148446028356d233dc13: 2023-07-12 16:14:32,364 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 22511d5e036ddb82c23bbeb49f2e1d50: 2023-07-12 16:14:32,364 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 16:14:32,364 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:32,364 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/cf/4b59056500034e18a28b839b79b275a2] hfiles 2023-07-12 16:14:32,364 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/cf/4b59056500034e18a28b839b79b275a2 for snapshot=snaptb0-testExportWithTargetName 2023-07-12 16:14:32,368 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 16:14:32,368 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:32,368 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/cf/7d8560cf7d15435a86bce9f56a5d779c] hfiles 2023-07-12 16:14:32,368 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/cf/7d8560cf7d15435a86bce9f56a5d779c for snapshot=snaptb0-testExportWithTargetName 2023-07-12 16:14:32,423 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. completed. 2023-07-12 16:14:32,423 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:32,423 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:32,423 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:32,423 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,423 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 16:14:32,423 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. completed. 2023-07-12 16:14:32,423 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,44777,1689178459404' in zk 2023-07-12 16:14:32,423 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:32,424 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:32,424 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:32,424 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,424 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 16:14:32,424 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase5.apache.org,43171,1689178459521' in zk 2023-07-12 16:14:32,429 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 16:14:32,429 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:32,429 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 16:14:32,432 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:32,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:32,436 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,436 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 16:14:32,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:32,436 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:32,436 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 16:14:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:32,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase5.apache.org,43171,1689178459521': 2023-07-12 16:14:32,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 16:14:32,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:32,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:32,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:32,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase5.apache.org,44777,1689178459404': 2023-07-12 16:14:32,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 16:14:32,455 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-12 16:14:32,455 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:14:32,455 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:14:32,455 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-12 16:14:32,455 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:14:32,457 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,457 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,457 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,457 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:32,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:32,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:32,457 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:32,457 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,458 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:32,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:32,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:32,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:32,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:32,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:32,464 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,465 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:32,467 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:32,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:32,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:32,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 16:14:32,473 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,474 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:32,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:32,475 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,490 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:32,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:32,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:32,490 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:32,490 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:32,490 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:32,491 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,491 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:32,490 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:32,491 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:32,491 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,491 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,491 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:32,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:32,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:32,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:32,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:32,490 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:32,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:32,491 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:32,493 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-12 16:14:32,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:32,493 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,493 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:32,493 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:32,493 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,493 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,493 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 16:14:32,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:32,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 16:14:32,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 16:14:32,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071226e4a5975af9442f97eaa9e32d01f1be, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071250bcd2c70e2b4cdfbf5dcc2cdee55fe6] mob files 2023-07-12 16:14:32,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071226e4a5975af9442f97eaa9e32d01f1be 2023-07-12 16:14:32,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071250bcd2c70e2b4cdfbf5dcc2cdee55fe6 2023-07-12 16:14:32,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-12 16:14:32,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 16:14:32,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,600 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 16:14:32,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689178472023Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689178472518 (+495 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689178472518Loading Region manifests for snaptb0-testExportWithTargetName at 1689178472518Writing data manifest for snaptb0-testExportWithTargetName at 1689178472525 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689178472542 (+17 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689178472599 (+57 ms) 2023-07-12 16:14:32,602 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 16:14:32,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 578 msec 2023-07-12 16:14:32,630 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:32,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 16:14:32,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:14:32,634 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178472634 2023-07-12 16:14:32,634 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46851, tgtDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178472634, rawTgtDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178472634, srcFsUri=hdfs://localhost:46851, srcDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:14:32,678 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:14:32,678 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1148907528_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178472634, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178472634/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 16:14:32,678 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756, snapshotDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-12 16:14:32,716 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178472634/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 16:14:32,838 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:32,839 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:32,840 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:32,840 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,850 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-5486110012554089113.jar 2023-07-12 16:14:33,850 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,851 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,925 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-7641784890679907384.jar 2023-07-12 16:14:33,925 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,926 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,926 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,927 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,927 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,928 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:33,928 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:14:33,929 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:14:33,929 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:14:33,930 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:14:33,930 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:14:33,931 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:14:33,931 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:14:33,931 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:14:33,932 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:14:33,932 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:14:33,936 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:33,937 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:33,937 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:14:33,937 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:33,937 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:33,938 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:14:33,938 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:14:35,507 WARN [Listener at jenkins-hbase5.apache.org/37867] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:14:35,514 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-12 16:14:35,525 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 16:14:36,038 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:14:36,040 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:14:36,462 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:14:36,708 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0001_000001 (auth:SIMPLE) 2023-07-12 16:14:42,162 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0001_000001 (auth:SIMPLE) 2023-07-12 16:14:44,453 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0001_000001 (auth:SIMPLE) 2023-07-12 16:14:48,134 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0001_000001 (auth:SIMPLE) 2023-07-12 16:14:49,518 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:14:49,520 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:14:49,529 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-12 16:14:49,530 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:14:49,530 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:14:49,531 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-454504975_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 16:14:49,531 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-12 16:14:49,531 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-12 16:14:49,531 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-454504975_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178472634/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178472634/.hbase-snapshot/testExportWithTargetName 2023-07-12 16:14:49,532 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178472634/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-12 16:14:49,532 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178472634/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-12 16:14:49,542 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-12 16:14:49,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportWithTargetName 2023-07-12 16:14:49,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:49,560 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178489560"}]},"ts":"1689178489560"} 2023-07-12 16:14:49,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 16:14:49,562 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-12 16:14:49,580 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-12 16:14:49,582 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=22511d5e036ddb82c23bbeb49f2e1d50, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d95f71e6368d148446028356d233dc13, UNASSIGN}] 2023-07-12 16:14:49,584 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d95f71e6368d148446028356d233dc13, UNASSIGN 2023-07-12 16:14:49,585 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=22511d5e036ddb82c23bbeb49f2e1d50, UNASSIGN 2023-07-12 16:14:49,586 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=d95f71e6368d148446028356d233dc13, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:49,586 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178489586"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178489586"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178489586"}]},"ts":"1689178489586"} 2023-07-12 16:14:49,586 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=22511d5e036ddb82c23bbeb49f2e1d50, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:49,586 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178489586"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178489586"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178489586"}]},"ts":"1689178489586"} 2023-07-12 16:14:49,588 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure d95f71e6368d148446028356d233dc13, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:14:49,589 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 22511d5e036ddb82c23bbeb49f2e1d50, server=jenkins-hbase5.apache.org,43171,1689178459521}] 2023-07-12 16:14:49,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 16:14:49,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close d95f71e6368d148446028356d233dc13 2023-07-12 16:14:49,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 22511d5e036ddb82c23bbeb49f2e1d50 2023-07-12 16:14:49,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing d95f71e6368d148446028356d233dc13, disabling compactions & flushes 2023-07-12 16:14:49,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 22511d5e036ddb82c23bbeb49f2e1d50, disabling compactions & flushes 2023-07-12 16:14:49,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:49,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:49,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:49,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:49,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. after waiting 0 ms 2023-07-12 16:14:49,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. after waiting 0 ms 2023-07-12 16:14:49,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:49,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:49,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:14:49,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:14:49,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:14:49,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50. 2023-07-12 16:14:49,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 22511d5e036ddb82c23bbeb49f2e1d50: 2023-07-12 16:14:49,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:14:49,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13. 2023-07-12 16:14:49,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for d95f71e6368d148446028356d233dc13: 2023-07-12 16:14:49,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 22511d5e036ddb82c23bbeb49f2e1d50 2023-07-12 16:14:49,770 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=22511d5e036ddb82c23bbeb49f2e1d50, regionState=CLOSED 2023-07-12 16:14:49,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed d95f71e6368d148446028356d233dc13 2023-07-12 16:14:49,770 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178489770"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178489770"}]},"ts":"1689178489770"} 2023-07-12 16:14:49,771 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=d95f71e6368d148446028356d233dc13, regionState=CLOSED 2023-07-12 16:14:49,771 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689178489771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178489771"}]},"ts":"1689178489771"} 2023-07-12 16:14:49,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-12 16:14:49,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 22511d5e036ddb82c23bbeb49f2e1d50, server=jenkins-hbase5.apache.org,43171,1689178459521 in 183 msec 2023-07-12 16:14:49,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-12 16:14:49,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure d95f71e6368d148446028356d233dc13, server=jenkins-hbase5.apache.org,44777,1689178459404 in 186 msec 2023-07-12 16:14:49,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=22511d5e036ddb82c23bbeb49f2e1d50, UNASSIGN in 194 msec 2023-07-12 16:14:49,780 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-12 16:14:49,780 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d95f71e6368d148446028356d233dc13, UNASSIGN in 195 msec 2023-07-12 16:14:49,781 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178489781"}]},"ts":"1689178489781"} 2023-07-12 16:14:49,782 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-12 16:14:49,784 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-12 16:14:49,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 235 msec 2023-07-12 16:14:49,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 16:14:49,864 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-12 16:14:49,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportWithTargetName 2023-07-12 16:14:49,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:49,882 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:49,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-12 16:14:49,884 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:49,887 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-12 16:14:49,891 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 16:14:49,891 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 16:14:49,891 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 16:14:49,891 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 16:14:49,891 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50 2023-07-12 16:14:49,892 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13 2023-07-12 16:14:49,895 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:49,895 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:49,896 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:49,896 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 16:14:49,896 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 16:14:49,896 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 16:14:49,896 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/recovered.edits] 2023-07-12 16:14:49,896 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:49,896 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 16:14:49,896 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/recovered.edits] 2023-07-12 16:14:49,896 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 16:14:49,896 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 16:14:49,896 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 16:14:49,896 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 16:14:49,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 16:14:49,907 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/cf/7d8560cf7d15435a86bce9f56a5d779c to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/cf/7d8560cf7d15435a86bce9f56a5d779c 2023-07-12 16:14:49,907 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/cf/4b59056500034e18a28b839b79b275a2 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/cf/4b59056500034e18a28b839b79b275a2 2023-07-12 16:14:49,912 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/recovered.edits/9.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50/recovered.edits/9.seqid 2023-07-12 16:14:49,912 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/recovered.edits/9.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13/recovered.edits/9.seqid 2023-07-12 16:14:49,913 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/22511d5e036ddb82c23bbeb49f2e1d50 2023-07-12 16:14:49,913 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportWithTargetName/d95f71e6368d148446028356d233dc13 2023-07-12 16:14:49,913 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 16:14:49,913 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 16:14:49,915 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-12 16:14:49,920 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071226e4a5975af9442f97eaa9e32d01f1be to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071226e4a5975af9442f97eaa9e32d01f1be 2023-07-12 16:14:49,922 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071250bcd2c70e2b4cdfbf5dcc2cdee55fe6 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071250bcd2c70e2b4cdfbf5dcc2cdee55fe6 2023-07-12 16:14:49,922 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 16:14:49,926 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:49,953 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-12 16:14:49,956 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-12 16:14:49,959 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:49,959 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-12 16:14:49,959 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178489959"}]},"ts":"9223372036854775807"} 2023-07-12 16:14:49,959 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178489959"}]},"ts":"9223372036854775807"} 2023-07-12 16:14:49,962 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 16:14:49,962 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 22511d5e036ddb82c23bbeb49f2e1d50, NAME => 'testtb-testExportWithTargetName,,1689178469991.22511d5e036ddb82c23bbeb49f2e1d50.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d95f71e6368d148446028356d233dc13, NAME => 'testtb-testExportWithTargetName,1,1689178469991.d95f71e6368d148446028356d233dc13.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 16:14:49,962 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-12 16:14:49,962 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178489962"}]},"ts":"9223372036854775807"} 2023-07-12 16:14:49,964 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-12 16:14:49,967 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 16:14:49,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 96 msec 2023-07-12 16:14:50,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 16:14:50,009 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-12 16:14:50,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-12 16:14:50,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-12 16:14:50,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-12 16:14:50,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-12 16:14:50,071 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 705) Potentially hanging thread: member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1427305754_1 at /127.0.0.1:35436 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:33252 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1427305754_1 at /127.0.0.1:52176 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase5.apache.org/172.31.10.131:41975 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase5.apache.org/172.31.10.131:41353 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1314 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x77775a31-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:35460 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:52198 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=288 (was 259) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 163) - ProcessCount LEAK? -, AvailableMemoryMB=4400 (was 6208) 2023-07-12 16:14:50,071 WARN [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-12 16:14:50,096 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=168, AvailableMemoryMB=4399 2023-07-12 16:14:50,096 WARN [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-12 16:14:50,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 16:14:50,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:14:50,104 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:14:50,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-12 16:14:50,106 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:14:50,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 16:14:50,111 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78 2023-07-12 16:14:50,111 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63 2023-07-12 16:14:50,112 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78 empty. 2023-07-12 16:14:50,112 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63 empty. 2023-07-12 16:14:50,112 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78 2023-07-12 16:14:50,113 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63 2023-07-12 16:14:50,113 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 16:14:50,146 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 16:14:50,160 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 003dde6823e6b68067c517ce89c7af78, NAME => 'testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:14:50,160 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => fe1b0fc4a665c4b3b39d13bc4a94eb63, NAME => 'testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:14:50,202 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:50,202 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:50,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing fe1b0fc4a665c4b3b39d13bc4a94eb63, disabling compactions & flushes 2023-07-12 16:14:50,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 003dde6823e6b68067c517ce89c7af78, disabling compactions & flushes 2023-07-12 16:14:50,203 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:14:50,203 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:14:50,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:14:50,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:14:50,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. after waiting 0 ms 2023-07-12 16:14:50,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. after waiting 0 ms 2023-07-12 16:14:50,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:14:50,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:14:50,204 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:14:50,204 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:14:50,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for fe1b0fc4a665c4b3b39d13bc4a94eb63: 2023-07-12 16:14:50,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 003dde6823e6b68067c517ce89c7af78: 2023-07-12 16:14:50,207 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:14:50,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 16:14:50,209 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178490208"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178490208"}]},"ts":"1689178490208"} 2023-07-12 16:14:50,209 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178490208"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178490208"}]},"ts":"1689178490208"} 2023-07-12 16:14:50,211 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:14:50,213 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:14:50,227 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178490213"}]},"ts":"1689178490213"} 2023-07-12 16:14:50,230 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 16:14:50,234 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:14:50,236 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:14:50,236 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:14:50,236 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:14:50,236 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:14:50,236 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=003dde6823e6b68067c517ce89c7af78, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe1b0fc4a665c4b3b39d13bc4a94eb63, ASSIGN}] 2023-07-12 16:14:50,240 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=003dde6823e6b68067c517ce89c7af78, ASSIGN 2023-07-12 16:14:50,240 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe1b0fc4a665c4b3b39d13bc4a94eb63, ASSIGN 2023-07-12 16:14:50,242 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe1b0fc4a665c4b3b39d13bc4a94eb63, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,43171,1689178459521; forceNewPlan=false, retain=false 2023-07-12 16:14:50,242 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=003dde6823e6b68067c517ce89c7af78, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44777,1689178459404; forceNewPlan=false, retain=false 2023-07-12 16:14:50,392 INFO [jenkins-hbase5:43373] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:14:50,395 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=003dde6823e6b68067c517ce89c7af78, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,395 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=fe1b0fc4a665c4b3b39d13bc4a94eb63, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,395 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178490395"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178490395"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178490395"}]},"ts":"1689178490395"} 2023-07-12 16:14:50,395 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178490395"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178490395"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178490395"}]},"ts":"1689178490395"} 2023-07-12 16:14:50,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 003dde6823e6b68067c517ce89c7af78, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:14:50,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure fe1b0fc4a665c4b3b39d13bc4a94eb63, server=jenkins-hbase5.apache.org,43171,1689178459521}] 2023-07-12 16:14:50,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 16:14:50,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:14:50,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 003dde6823e6b68067c517ce89c7af78, NAME => 'testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 16:14:50,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. service=AccessControlService 2023-07-12 16:14:50,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:50,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:14:50,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 003dde6823e6b68067c517ce89c7af78 2023-07-12 16:14:50,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe1b0fc4a665c4b3b39d13bc4a94eb63, NAME => 'testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 16:14:50,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:50,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 003dde6823e6b68067c517ce89c7af78 2023-07-12 16:14:50,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 003dde6823e6b68067c517ce89c7af78 2023-07-12 16:14:50,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. service=AccessControlService 2023-07-12 16:14:50,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:14:50,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState fe1b0fc4a665c4b3b39d13bc4a94eb63 2023-07-12 16:14:50,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:14:50,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for fe1b0fc4a665c4b3b39d13bc4a94eb63 2023-07-12 16:14:50,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for fe1b0fc4a665c4b3b39d13bc4a94eb63 2023-07-12 16:14:50,560 INFO [StoreOpener-003dde6823e6b68067c517ce89c7af78-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 003dde6823e6b68067c517ce89c7af78 2023-07-12 16:14:50,560 INFO [StoreOpener-fe1b0fc4a665c4b3b39d13bc4a94eb63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fe1b0fc4a665c4b3b39d13bc4a94eb63 2023-07-12 16:14:50,561 DEBUG [StoreOpener-003dde6823e6b68067c517ce89c7af78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/cf 2023-07-12 16:14:50,561 DEBUG [StoreOpener-003dde6823e6b68067c517ce89c7af78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/cf 2023-07-12 16:14:50,562 DEBUG [StoreOpener-fe1b0fc4a665c4b3b39d13bc4a94eb63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/cf 2023-07-12 16:14:50,562 DEBUG [StoreOpener-fe1b0fc4a665c4b3b39d13bc4a94eb63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/cf 2023-07-12 16:14:50,562 INFO [StoreOpener-003dde6823e6b68067c517ce89c7af78-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 003dde6823e6b68067c517ce89c7af78 columnFamilyName cf 2023-07-12 16:14:50,562 INFO [StoreOpener-fe1b0fc4a665c4b3b39d13bc4a94eb63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe1b0fc4a665c4b3b39d13bc4a94eb63 columnFamilyName cf 2023-07-12 16:14:50,564 INFO [StoreOpener-003dde6823e6b68067c517ce89c7af78-1] regionserver.HStore(310): Store=003dde6823e6b68067c517ce89c7af78/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:50,565 INFO [StoreOpener-fe1b0fc4a665c4b3b39d13bc4a94eb63-1] regionserver.HStore(310): Store=fe1b0fc4a665c4b3b39d13bc4a94eb63/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:14:50,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63 2023-07-12 16:14:50,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78 2023-07-12 16:14:50,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63 2023-07-12 16:14:50,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78 2023-07-12 16:14:50,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for fe1b0fc4a665c4b3b39d13bc4a94eb63 2023-07-12 16:14:50,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 003dde6823e6b68067c517ce89c7af78 2023-07-12 16:14:50,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:50,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:14:50,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened fe1b0fc4a665c4b3b39d13bc4a94eb63; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62160870, jitterRate=-0.07373085618019104}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:50,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for fe1b0fc4a665c4b3b39d13bc4a94eb63: 2023-07-12 16:14:50,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 003dde6823e6b68067c517ce89c7af78; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65083605, jitterRate=-0.03017871081829071}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:14:50,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 003dde6823e6b68067c517ce89c7af78: 2023-07-12 16:14:50,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78., pid=30, masterSystemTime=1689178490553 2023-07-12 16:14:50,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63., pid=31, masterSystemTime=1689178490554 2023-07-12 16:14:50,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:14:50,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:14:50,581 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=fe1b0fc4a665c4b3b39d13bc4a94eb63, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,581 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178490581"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178490581"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178490581"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178490581"}]},"ts":"1689178490581"} 2023-07-12 16:14:50,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:14:50,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:14:50,582 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=003dde6823e6b68067c517ce89c7af78, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,586 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178490582"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178490582"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178490582"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178490582"}]},"ts":"1689178490582"} 2023-07-12 16:14:50,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-12 16:14:50,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure fe1b0fc4a665c4b3b39d13bc4a94eb63, server=jenkins-hbase5.apache.org,43171,1689178459521 in 189 msec 2023-07-12 16:14:50,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-12 16:14:50,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 003dde6823e6b68067c517ce89c7af78, server=jenkins-hbase5.apache.org,44777,1689178459404 in 192 msec 2023-07-12 16:14:50,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe1b0fc4a665c4b3b39d13bc4a94eb63, ASSIGN in 360 msec 2023-07-12 16:14:50,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-12 16:14:50,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=003dde6823e6b68067c517ce89c7af78, ASSIGN in 361 msec 2023-07-12 16:14:50,602 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:14:50,602 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178490602"}]},"ts":"1689178490602"} 2023-07-12 16:14:50,604 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 16:14:50,607 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:14:50,608 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-12 16:14:50,610 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 16:14:50,612 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:50,612 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:50,612 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:50,612 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:14:50,613 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:50,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:50,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:50,614 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:14:50,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 514 msec 2023-07-12 16:14:50,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 16:14:50,711 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-12 16:14:50,718 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 16:14:50,718 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:14:50,720 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:14:50,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:14:50,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178490736 (current time:1689178490736). 2023-07-12 16:14:50,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:14:50,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x465ca23e to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:50,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a6ef6f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:50,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:50,744 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:42254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:50,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x465ca23e to 127.0.0.1:53717 2023-07-12 16:14:50,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:50,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x7530abf5 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:50,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@565eaa3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:50,752 DEBUG [hconnection-0x2b7a5733-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:50,755 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:42266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:50,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:50,759 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:60996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:50,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7530abf5 to 127.0.0.1:53717 2023-07-12 16:14:50,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:50,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 16:14:50,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:14:50,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:14:50,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:14:50,765 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:14:50,766 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689179090766 2023-07-12 16:14:50,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:14:50,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 16:14:50,768 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:14:50,768 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:14:50,769 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:14:50,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 16:14:50,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-12 16:14:50,771 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 16:14:50,772 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689179090772 2023-07-12 16:14:50,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,785 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-12 16:14:50,785 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:50,786 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 16:14:50,786 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 16:14:50,787 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,787 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,788 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:50,788 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:50,788 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:50,788 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:50,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:50,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:50,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:50,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:50,788 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,789 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:50,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,789 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,789 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:14:50,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 16:14:50,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 16:14:50,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,790 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 16:14:50,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 16:14:50,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,790 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 16:14:50,790 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,790 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 16:14:50,790 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 16:14:50,790 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:50,791 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 16:14:50,791 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,791 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 16:14:50,792 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 16:14:50,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,792 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 16:14:50,792 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 16:14:50,792 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:50,792 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:50,794 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 16:14:50,794 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 16:14:50,794 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 16:14:50,794 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 16:14:50,794 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 16:14:50,794 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 16:14:50,796 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,796 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:50,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:50,800 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,800 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,800 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:50,800 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:50,800 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,801 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:50,800 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,801 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,801 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:50,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:50,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:50,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 16:14:50,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2529db1a[Count = 1] remaining members to acquire global barrier 2023-07-12 16:14:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:50,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:50,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:50,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:50,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 16:14:50,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2529db1a[Count = 0] remaining members to acquire global barrier 2023-07-12 16:14:50,805 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 16:14:50,805 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,806 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,806 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,806 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,806 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,806 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:14:50,806 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:14:50,806 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 16:14:50,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,806 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,41787,1689178459474' in zk 2023-07-12 16:14:50,807 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:14:50,807 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:50,807 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:50,807 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:14:50,807 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:50,807 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:50,807 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:14:50,807 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. started... 2023-07-12 16:14:50,807 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,807 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:14:50,807 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. started... 2023-07-12 16:14:50,808 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fe1b0fc4a665c4b3b39d13bc4a94eb63: 2023-07-12 16:14:50,808 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 003dde6823e6b68067c517ce89c7af78: 2023-07-12 16:14:50,809 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,809 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:50,809 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,809 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:14:50,809 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:50,809 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:14:50,811 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 16:14:50,811 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:50,811 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 16:14:50,824 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. completed. 2023-07-12 16:14:50,824 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:14:50,824 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:50,824 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:50,824 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,824 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 16:14:50,824 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,44777,1689178459404' in zk 2023-07-12 16:14:50,826 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,826 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 16:14:50,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:50,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:50,826 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:50,826 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 16:14:50,827 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. completed. 2023-07-12 16:14:50,827 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:14:50,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:50,827 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:50,828 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:50,828 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,828 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 16:14:50,828 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,43171,1689178459521' in zk 2023-07-12 16:14:50,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:50,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,829 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,829 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 16:14:50,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,829 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:50,829 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 16:14:50,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase5.apache.org,44777,1689178459404': 2023-07-12 16:14:50,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 16:14:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:50,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:50,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:50,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:50,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase5.apache.org,43171,1689178459521': 2023-07-12 16:14:50,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 16:14:50,836 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-12 16:14:50,836 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:14:50,836 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:14:50,836 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,836 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:14:50,838 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,838 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,838 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,838 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:50,838 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,838 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:50,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:50,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:50,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,838 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:50,839 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:50,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:50,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:50,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:50,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,840 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:50,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,840 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:50,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:50,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,842 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:50,843 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:50,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,843 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:50,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,851 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,851 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,851 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:50,851 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:50,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:50,851 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:50,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:50,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:50,851 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:50,851 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:50,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:50,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:50,851 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:50,851 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:50,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:50,851 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:50,853 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 16:14:50,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:50,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:50,851 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:50,853 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:50,853 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 16:14:50,852 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:50,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:50,853 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,853 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:50,853 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,853 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:50,853 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:50,853 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,853 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 16:14:50,868 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:50,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:14:50,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:50,869 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:14:50,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,940 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 16:14:50,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,940 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 16:14:50,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689178490767Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689178490875 (+108 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689178490875Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689178490875Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689178490887 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689178490900 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689178490940 (+40 ms) 2023-07-12 16:14:50,943 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 16:14:50,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 176 msec 2023-07-12 16:14:51,070 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:51,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:14:51,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:14:51,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44777] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:14:51,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43171] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:14:51,082 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 16:14:51,082 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:14:51,082 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:14:51,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:14:51,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178491096 (current time:1689178491096). 2023-07-12 16:14:51,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:14:51,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x3aee02c9 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:51,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13eebdc2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:51,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:51,112 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:42274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:51,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aee02c9 to 127.0.0.1:53717 2023-07-12 16:14:51,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:51,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x5208cf2d to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:14:51,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7edcc987, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:14:51,124 DEBUG [hconnection-0x2503ebd8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:51,126 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:42288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:51,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:14:51,134 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:32776, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:14:51,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5208cf2d to 127.0.0.1:53717 2023-07-12 16:14:51,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:14:51,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 16:14:51,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:14:51,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:14:51,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:14:51,141 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:14:51,142 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689179091142 2023-07-12 16:14:51,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:14:51,142 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 16:14:51,143 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:14:51,143 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:14:51,144 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:14:51,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 16:14:51,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-12 16:14:51,147 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 16:14:51,148 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689179091148 2023-07-12 16:14:51,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-12 16:14:51,165 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-12 16:14:51,165 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:51,167 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 16:14:51,167 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 16:14:51,167 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,167 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,168 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:51,168 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:51,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:51,169 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,169 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:51,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:51,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:51,169 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,169 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,170 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,170 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:14:51,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 16:14:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 16:14:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,170 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 16:14:51,170 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 16:14:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 16:14:51,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,171 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 16:14:51,171 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 16:14:51,171 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 16:14:51,171 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 16:14:51,171 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 16:14:51,171 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:51,171 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 16:14:51,172 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 16:14:51,172 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 16:14:51,172 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:51,171 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:14:51,174 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 16:14:51,174 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 16:14:51,175 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 16:14:51,172 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 16:14:51,175 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 16:14:51,174 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 16:14:51,175 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 16:14:51,175 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 16:14:51,176 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,176 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:51,177 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,177 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:51,177 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,177 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:51,177 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,178 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,178 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:51,178 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,178 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:14:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:51,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:51,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 16:14:51,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30bc9a4f[Count = 1] remaining members to acquire global barrier 2023-07-12 16:14:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:51,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:51,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:51,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 16:14:51,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30bc9a4f[Count = 0] remaining members to acquire global barrier 2023-07-12 16:14:51,182 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 16:14:51,182 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,184 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,184 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,184 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,184 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:14:51,185 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:14:51,184 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,185 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 16:14:51,185 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:51,185 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:51,185 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,41787,1689178459474' in zk 2023-07-12 16:14:51,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,185 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:14:51,185 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:14:51,185 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,185 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. started... 2023-07-12 16:14:51,185 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:14:51,185 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:14:51,185 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:14:51,185 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:14:51,185 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 003dde6823e6b68067c517ce89c7af78 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-12 16:14:51,185 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. started... 2023-07-12 16:14:51,186 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fe1b0fc4a665c4b3b39d13bc4a94eb63 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-12 16:14:51,187 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 16:14:51,187 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:51,187 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 16:14:51,241 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712cf17486f17e347d4ab4d680beeaf51f1 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712cf17486f17e347d4ab4d680beeaf51f1 2023-07-12 16:14:51,243 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:51,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:14:51,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:51,245 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:14:51,250 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071218ae014f047a4e00ab896d8d996d87cd to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071218ae014f047a4e00ab896d8d996d87cd 2023-07-12 16:14:51,266 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/.tmp/cf/c74f43f2b9634bcc82f696c3ec892f14 2023-07-12 16:14:51,275 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/.tmp/cf/2497b6d497184f0fab5309c04f50244c 2023-07-12 16:14:51,275 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/.tmp/cf/c74f43f2b9634bcc82f696c3ec892f14 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/cf/c74f43f2b9634bcc82f696c3ec892f14 2023-07-12 16:14:51,284 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/.tmp/cf/2497b6d497184f0fab5309c04f50244c as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/cf/2497b6d497184f0fab5309c04f50244c 2023-07-12 16:14:51,285 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/cf/c74f43f2b9634bcc82f696c3ec892f14, entries=6, sequenceid=6, filesize=5.9 K 2023-07-12 16:14:51,286 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 003dde6823e6b68067c517ce89c7af78 in 101ms, sequenceid=6, compaction requested=false 2023-07-12 16:14:51,286 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 16:14:51,288 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 003dde6823e6b68067c517ce89c7af78: 2023-07-12 16:14:51,288 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 16:14:51,288 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:51,288 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/cf/c74f43f2b9634bcc82f696c3ec892f14] hfiles 2023-07-12 16:14:51,288 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/cf/c74f43f2b9634bcc82f696c3ec892f14 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 16:14:51,295 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/cf/2497b6d497184f0fab5309c04f50244c, entries=44, sequenceid=6, filesize=12.3 K 2023-07-12 16:14:51,296 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for fe1b0fc4a665c4b3b39d13bc4a94eb63 in 110ms, sequenceid=6, compaction requested=false 2023-07-12 16:14:51,305 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fe1b0fc4a665c4b3b39d13bc4a94eb63: 2023-07-12 16:14:51,306 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 16:14:51,306 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:14:51,306 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/cf/2497b6d497184f0fab5309c04f50244c] hfiles 2023-07-12 16:14:51,306 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/cf/2497b6d497184f0fab5309c04f50244c for snapshot=snaptb0-testExportFileSystemState 2023-07-12 16:14:51,344 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. completed. 2023-07-12 16:14:51,344 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:14:51,344 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:51,344 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:51,344 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,344 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 16:14:51,344 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,43171,1689178459521' in zk 2023-07-12 16:14:51,349 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 16:14:51,349 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. completed. 2023-07-12 16:14:51,349 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:51,349 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,349 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 16:14:51,349 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:14:51,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,350 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:14:51,350 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:14:51,350 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:51,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:51,351 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 16:14:51,351 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,44777,1689178459404' in zk 2023-07-12 16:14:51,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:51,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:51,352 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:51,352 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 16:14:51,353 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:51,353 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 16:14:51,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:51,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:51,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:51,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:51,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase5.apache.org,43171,1689178459521': 2023-07-12 16:14:51,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 16:14:51,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:51,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:51,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:51,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:51,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:51,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:51,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:51,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:51,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:51,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase5.apache.org,44777,1689178459404': 2023-07-12 16:14:51,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 16:14:51,362 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-12 16:14:51,362 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:14:51,362 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:14:51,362 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-12 16:14:51,362 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:14:51,363 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,364 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,364 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,364 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,364 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:14:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:14:51,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,364 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,364 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:51,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:51,365 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:14:51,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:51,366 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:14:51,366 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:51,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:14:51,368 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 16:14:51,369 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,369 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:51,373 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:51,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:51,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:51,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:51,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:51,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:51,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:51,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:51,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-12 16:14:51,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:14:51,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 16:14:51,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:14:51,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 16:14:51,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:51,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 16:14:51,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:14:51,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:51,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:51,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:14:51,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:51,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:51,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:14:51,374 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,376 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,376 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:14:51,376 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:14:51,376 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,374 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:14:51,376 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:14:51,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:14:51,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071218ae014f047a4e00ab896d8d996d87cd, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712cf17486f17e347d4ab4d680beeaf51f1] mob files 2023-07-12 16:14:51,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071218ae014f047a4e00ab896d8d996d87cd 2023-07-12 16:14:51,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712cf17486f17e347d4ab4d680beeaf51f1 2023-07-12 16:14:51,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState because node does not exist (not an error) 2023-07-12 16:14:51,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-12 16:14:51,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,445 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:51,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:14:51,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:14:51,447 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 16:14:51,454 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 16:14:51,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,455 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689178491142Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689178491393 (+251 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689178491393Loading Region manifests for snaptb0-testExportFileSystemState at 1689178491393Writing data manifest for snaptb0-testExportFileSystemState at 1689178491397 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689178491412 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689178491454 (+42 ms) 2023-07-12 16:14:51,457 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 16:14:51,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 314 msec 2023-07-12 16:14:51,747 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:14:51,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:14:51,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:14:51,749 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178491749 2023-07-12 16:14:51,749 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46851, tgtDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178491749, rawTgtDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178491749, srcFsUri=hdfs://localhost:46851, srcDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:14:51,779 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:14:51,779 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_924768500_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178491749, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178491749/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,779 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756, snapshotDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-12 16:14:51,804 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178491749/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 16:14:51,834 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:51,835 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:51,835 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:51,835 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:52,819 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-4357435082090593748.jar 2023-07-12 16:14:52,820 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:52,820 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:52,892 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-6898514725175052968.jar 2023-07-12 16:14:52,892 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:52,893 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:52,894 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:52,894 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:52,894 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:52,895 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:14:52,895 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:14:52,896 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:14:52,896 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:14:52,896 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:14:52,897 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:14:52,897 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:14:52,898 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:14:52,898 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:14:52,898 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:14:52,899 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:14:52,900 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:52,900 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:52,901 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:14:52,901 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:52,901 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:14:52,902 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:14:52,903 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:14:53,468 WARN [Listener at jenkins-hbase5.apache.org/37867] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:14:53,471 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-12 16:14:53,474 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 16:14:54,345 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:14:54,345 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:14:54,352 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0001_000001 (auth:SIMPLE) 2023-07-12 16:14:54,892 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0002_000001 (auth:SIMPLE) 2023-07-12 16:14:55,372 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:14:59,733 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0002_000001 (auth:SIMPLE) 2023-07-12 16:15:02,016 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0002_000001 (auth:SIMPLE) 2023-07-12 16:15:05,293 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0002_000001 (auth:SIMPLE) 2023-07-12 16:15:06,729 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:15:06,732 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:15:06,743 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-12 16:15:06,743 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:15:06,744 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:15:06,744 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-454504975_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 16:15:06,744 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 16:15:06,744 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 16:15:06,744 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-454504975_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178491749/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178491749/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 16:15:06,745 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178491749/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 16:15:06,745 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178491749/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 16:15:06,753 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-12 16:15:06,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportFileSystemState 2023-07-12 16:15:06,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:06,760 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178506760"}]},"ts":"1689178506760"} 2023-07-12 16:15:06,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 16:15:06,761 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 16:15:06,763 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-12 16:15:06,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=003dde6823e6b68067c517ce89c7af78, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe1b0fc4a665c4b3b39d13bc4a94eb63, UNASSIGN}] 2023-07-12 16:15:06,766 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe1b0fc4a665c4b3b39d13bc4a94eb63, UNASSIGN 2023-07-12 16:15:06,766 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=003dde6823e6b68067c517ce89c7af78, UNASSIGN 2023-07-12 16:15:06,767 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=fe1b0fc4a665c4b3b39d13bc4a94eb63, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:06,767 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=003dde6823e6b68067c517ce89c7af78, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:06,768 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178506767"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178506767"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178506767"}]},"ts":"1689178506767"} 2023-07-12 16:15:06,768 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178506767"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178506767"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178506767"}]},"ts":"1689178506767"} 2023-07-12 16:15:06,769 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 003dde6823e6b68067c517ce89c7af78, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:15:06,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure fe1b0fc4a665c4b3b39d13bc4a94eb63, server=jenkins-hbase5.apache.org,43171,1689178459521}] 2023-07-12 16:15:06,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 16:15:06,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close fe1b0fc4a665c4b3b39d13bc4a94eb63 2023-07-12 16:15:06,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 003dde6823e6b68067c517ce89c7af78 2023-07-12 16:15:06,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing fe1b0fc4a665c4b3b39d13bc4a94eb63, disabling compactions & flushes 2023-07-12 16:15:06,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 003dde6823e6b68067c517ce89c7af78, disabling compactions & flushes 2023-07-12 16:15:06,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:15:06,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:15:06,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:15:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:15:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. after waiting 0 ms 2023-07-12 16:15:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. after waiting 0 ms 2023-07-12 16:15:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:15:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:15:06,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:15:06,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:15:06,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:15:06,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:15:06,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78. 2023-07-12 16:15:06,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63. 2023-07-12 16:15:06,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 003dde6823e6b68067c517ce89c7af78: 2023-07-12 16:15:06,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for fe1b0fc4a665c4b3b39d13bc4a94eb63: 2023-07-12 16:15:06,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 003dde6823e6b68067c517ce89c7af78 2023-07-12 16:15:06,940 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=003dde6823e6b68067c517ce89c7af78, regionState=CLOSED 2023-07-12 16:15:06,941 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178506940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178506940"}]},"ts":"1689178506940"} 2023-07-12 16:15:06,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed fe1b0fc4a665c4b3b39d13bc4a94eb63 2023-07-12 16:15:06,941 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=fe1b0fc4a665c4b3b39d13bc4a94eb63, regionState=CLOSED 2023-07-12 16:15:06,942 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689178506941"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178506941"}]},"ts":"1689178506941"} 2023-07-12 16:15:06,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-12 16:15:06,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 003dde6823e6b68067c517ce89c7af78, server=jenkins-hbase5.apache.org,44777,1689178459404 in 173 msec 2023-07-12 16:15:06,946 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-12 16:15:06,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure fe1b0fc4a665c4b3b39d13bc4a94eb63, server=jenkins-hbase5.apache.org,43171,1689178459521 in 174 msec 2023-07-12 16:15:06,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=003dde6823e6b68067c517ce89c7af78, UNASSIGN in 182 msec 2023-07-12 16:15:06,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-12 16:15:06,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fe1b0fc4a665c4b3b39d13bc4a94eb63, UNASSIGN in 183 msec 2023-07-12 16:15:06,949 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178506949"}]},"ts":"1689178506949"} 2023-07-12 16:15:06,951 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 16:15:06,952 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-12 16:15:06,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 199 msec 2023-07-12 16:15:07,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 16:15:07,064 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-12 16:15:07,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportFileSystemState 2023-07-12 16:15:07,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:07,069 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:07,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-12 16:15:07,070 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:07,072 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-12 16:15:07,075 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:07,075 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:07,075 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:07,075 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:07,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 16:15:07,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 16:15:07,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 16:15:07,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 16:15:07,076 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78 2023-07-12 16:15:07,076 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63 2023-07-12 16:15:07,078 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:07,078 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:07,078 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:07,078 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:07,078 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:07,078 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:07,078 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 16:15:07,078 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:07,079 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/recovered.edits] 2023-07-12 16:15:07,079 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/recovered.edits] 2023-07-12 16:15:07,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 16:15:07,084 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/cf/c74f43f2b9634bcc82f696c3ec892f14 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/cf/c74f43f2b9634bcc82f696c3ec892f14 2023-07-12 16:15:07,085 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/cf/2497b6d497184f0fab5309c04f50244c to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/cf/2497b6d497184f0fab5309c04f50244c 2023-07-12 16:15:07,088 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/recovered.edits/9.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78/recovered.edits/9.seqid 2023-07-12 16:15:07,089 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/003dde6823e6b68067c517ce89c7af78 2023-07-12 16:15:07,089 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/recovered.edits/9.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63/recovered.edits/9.seqid 2023-07-12 16:15:07,090 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemState/fe1b0fc4a665c4b3b39d13bc4a94eb63 2023-07-12 16:15:07,090 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 16:15:07,090 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 16:15:07,091 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-12 16:15:07,096 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071218ae014f047a4e00ab896d8d996d87cd to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071218ae014f047a4e00ab896d8d996d87cd 2023-07-12 16:15:07,098 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712cf17486f17e347d4ab4d680beeaf51f1 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712cf17486f17e347d4ab4d680beeaf51f1 2023-07-12 16:15:07,098 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 16:15:07,101 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:07,104 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-12 16:15:07,107 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-12 16:15:07,108 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:07,108 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-12 16:15:07,109 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178507108"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:07,109 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178507108"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:07,111 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 16:15:07,111 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 003dde6823e6b68067c517ce89c7af78, NAME => 'testtb-testExportFileSystemState,,1689178490098.003dde6823e6b68067c517ce89c7af78.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fe1b0fc4a665c4b3b39d13bc4a94eb63, NAME => 'testtb-testExportFileSystemState,1,1689178490098.fe1b0fc4a665c4b3b39d13bc4a94eb63.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 16:15:07,111 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-12 16:15:07,111 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178507111"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:07,113 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-12 16:15:07,116 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 16:15:07,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 51 msec 2023-07-12 16:15:07,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 16:15:07,182 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-12 16:15:07,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-12 16:15:07,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-12 16:15:07,198 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-12 16:15:07,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-12 16:15:07,243 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=762 (was 752) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:45266 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1414057372_1 at /127.0.0.1:32804 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase5.apache.org/172.31.10.131:43309 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:45106 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2030 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1414057372_1 at /127.0.0.1:58370 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:42696 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=374 (was 288) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4162 (was 4399) 2023-07-12 16:15:07,244 WARN [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 16:15:07,267 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=374, ProcessCount=168, AvailableMemoryMB=4160 2023-07-12 16:15:07,267 WARN [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 16:15:07,269 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 16:15:07,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:07,273 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:15:07,273 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-12 16:15:07,274 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:15:07,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 16:15:07,277 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085 2023-07-12 16:15:07,277 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328 2023-07-12 16:15:07,278 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328 empty. 2023-07-12 16:15:07,278 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085 empty. 2023-07-12 16:15:07,278 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328 2023-07-12 16:15:07,278 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085 2023-07-12 16:15:07,278 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 16:15:07,300 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-12 16:15:07,302 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 116386608e3a603c3f43c73994f97085, NAME => 'testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:15:07,302 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 969347d794042989f6cc45424b830328, NAME => 'testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:15:07,339 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:07,339 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 116386608e3a603c3f43c73994f97085, disabling compactions & flushes 2023-07-12 16:15:07,339 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:07,339 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:07,339 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. after waiting 0 ms 2023-07-12 16:15:07,339 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:07,339 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:07,339 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 116386608e3a603c3f43c73994f97085: 2023-07-12 16:15:07,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:07,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 969347d794042989f6cc45424b830328, disabling compactions & flushes 2023-07-12 16:15:07,340 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:07,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:07,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. after waiting 0 ms 2023-07-12 16:15:07,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:07,340 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:07,340 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 969347d794042989f6cc45424b830328: 2023-07-12 16:15:07,343 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:15:07,344 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178507344"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178507344"}]},"ts":"1689178507344"} 2023-07-12 16:15:07,344 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178507344"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178507344"}]},"ts":"1689178507344"} 2023-07-12 16:15:07,347 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:15:07,348 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:15:07,348 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178507348"}]},"ts":"1689178507348"} 2023-07-12 16:15:07,349 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-12 16:15:07,354 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:15:07,355 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:15:07,355 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:15:07,355 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:15:07,355 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:15:07,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=116386608e3a603c3f43c73994f97085, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=969347d794042989f6cc45424b830328, ASSIGN}] 2023-07-12 16:15:07,358 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=969347d794042989f6cc45424b830328, ASSIGN 2023-07-12 16:15:07,358 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=116386608e3a603c3f43c73994f97085, ASSIGN 2023-07-12 16:15:07,359 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=116386608e3a603c3f43c73994f97085, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,43171,1689178459521; forceNewPlan=false, retain=false 2023-07-12 16:15:07,359 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=969347d794042989f6cc45424b830328, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44777,1689178459404; forceNewPlan=false, retain=false 2023-07-12 16:15:07,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 16:15:07,509 INFO [jenkins-hbase5:43373] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:15:07,514 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=116386608e3a603c3f43c73994f97085, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:07,514 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=969347d794042989f6cc45424b830328, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:07,514 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178507514"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178507514"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178507514"}]},"ts":"1689178507514"} 2023-07-12 16:15:07,514 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178507514"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178507514"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178507514"}]},"ts":"1689178507514"} 2023-07-12 16:15:07,516 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 116386608e3a603c3f43c73994f97085, server=jenkins-hbase5.apache.org,43171,1689178459521}] 2023-07-12 16:15:07,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 969347d794042989f6cc45424b830328, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:15:07,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 16:15:07,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:07,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 116386608e3a603c3f43c73994f97085, NAME => 'testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 16:15:07,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:07,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. service=AccessControlService 2023-07-12 16:15:07,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 969347d794042989f6cc45424b830328, NAME => 'testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 16:15:07,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:07,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. service=AccessControlService 2023-07-12 16:15:07,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 116386608e3a603c3f43c73994f97085 2023-07-12 16:15:07,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:07,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:07,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 969347d794042989f6cc45424b830328 2023-07-12 16:15:07,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 116386608e3a603c3f43c73994f97085 2023-07-12 16:15:07,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:07,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 116386608e3a603c3f43c73994f97085 2023-07-12 16:15:07,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 969347d794042989f6cc45424b830328 2023-07-12 16:15:07,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 969347d794042989f6cc45424b830328 2023-07-12 16:15:07,675 INFO [StoreOpener-116386608e3a603c3f43c73994f97085-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 116386608e3a603c3f43c73994f97085 2023-07-12 16:15:07,675 INFO [StoreOpener-969347d794042989f6cc45424b830328-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 969347d794042989f6cc45424b830328 2023-07-12 16:15:07,676 DEBUG [StoreOpener-116386608e3a603c3f43c73994f97085-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/cf 2023-07-12 16:15:07,677 DEBUG [StoreOpener-969347d794042989f6cc45424b830328-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/cf 2023-07-12 16:15:07,677 DEBUG [StoreOpener-969347d794042989f6cc45424b830328-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/cf 2023-07-12 16:15:07,677 DEBUG [StoreOpener-116386608e3a603c3f43c73994f97085-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/cf 2023-07-12 16:15:07,677 INFO [StoreOpener-969347d794042989f6cc45424b830328-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 969347d794042989f6cc45424b830328 columnFamilyName cf 2023-07-12 16:15:07,677 INFO [StoreOpener-116386608e3a603c3f43c73994f97085-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 116386608e3a603c3f43c73994f97085 columnFamilyName cf 2023-07-12 16:15:07,678 INFO [StoreOpener-969347d794042989f6cc45424b830328-1] regionserver.HStore(310): Store=969347d794042989f6cc45424b830328/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:07,678 INFO [StoreOpener-116386608e3a603c3f43c73994f97085-1] regionserver.HStore(310): Store=116386608e3a603c3f43c73994f97085/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:07,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328 2023-07-12 16:15:07,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085 2023-07-12 16:15:07,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328 2023-07-12 16:15:07,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085 2023-07-12 16:15:07,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 116386608e3a603c3f43c73994f97085 2023-07-12 16:15:07,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 969347d794042989f6cc45424b830328 2023-07-12 16:15:07,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:15:07,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:15:07,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 116386608e3a603c3f43c73994f97085; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63710286, jitterRate=-0.05064275860786438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:07,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 116386608e3a603c3f43c73994f97085: 2023-07-12 16:15:07,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 969347d794042989f6cc45424b830328; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72532219, jitterRate=0.08081428706645966}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:07,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 969347d794042989f6cc45424b830328: 2023-07-12 16:15:07,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085., pid=45, masterSystemTime=1689178507668 2023-07-12 16:15:07,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328., pid=46, masterSystemTime=1689178507670 2023-07-12 16:15:07,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:07,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:07,689 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=969347d794042989f6cc45424b830328, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:07,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:07,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:07,689 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178507689"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178507689"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178507689"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178507689"}]},"ts":"1689178507689"} 2023-07-12 16:15:07,690 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=116386608e3a603c3f43c73994f97085, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:07,690 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178507690"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178507690"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178507690"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178507690"}]},"ts":"1689178507690"} 2023-07-12 16:15:07,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-12 16:15:07,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 969347d794042989f6cc45424b830328, server=jenkins-hbase5.apache.org,44777,1689178459404 in 174 msec 2023-07-12 16:15:07,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-12 16:15:07,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 116386608e3a603c3f43c73994f97085, server=jenkins-hbase5.apache.org,43171,1689178459521 in 176 msec 2023-07-12 16:15:07,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=969347d794042989f6cc45424b830328, ASSIGN in 338 msec 2023-07-12 16:15:07,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-12 16:15:07,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=116386608e3a603c3f43c73994f97085, ASSIGN in 340 msec 2023-07-12 16:15:07,698 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:15:07,698 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178507698"}]},"ts":"1689178507698"} 2023-07-12 16:15:07,700 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-12 16:15:07,702 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:15:07,703 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-12 16:15:07,705 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 16:15:07,707 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:07,707 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:07,707 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:07,707 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:07,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:07,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:07,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:07,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:07,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 440 msec 2023-07-12 16:15:07,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 16:15:07,878 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-12 16:15:07,881 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 16:15:07,881 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:07,883 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:15:07,894 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 16:15:07,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178507894 (current time:1689178507894). 2023-07-12 16:15:07,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:15:07,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x09d43bbd to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:07,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56b3a923, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:07,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:07,907 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:56698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:07,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09d43bbd to 127.0.0.1:53717 2023-07-12 16:15:07,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:07,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x2ea740db to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:07,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6069f61, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:07,914 DEBUG [hconnection-0x4db7c433-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:07,917 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:56700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:07,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:07,924 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:07,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ea740db to 127.0.0.1:53717 2023-07-12 16:15:07,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:07,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 16:15:07,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:15:07,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 16:15:07,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 16:15:07,931 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 16:15:07,932 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689179107931 2023-07-12 16:15:07,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 16:15:07,932 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 16:15:07,932 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:15:07,933 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:15:07,934 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 16:15:07,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 16:15:07,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-12 16:15:07,937 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 16:15:07,938 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689179107938 2023-07-12 16:15:07,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:07,951 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-12 16:15:07,952 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:07,953 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 16:15:07,953 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 16:15:08,030 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,031 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,033 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:08,033 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:08,033 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:08,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:08,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:08,033 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:08,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:08,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:08,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:08,033 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,034 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,034 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 16:15:08,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:08,035 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:15:08,036 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 16:15:08,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,036 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:15:08,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 16:15:08,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,036 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 16:15:08,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,037 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 16:15:08,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,037 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 16:15:08,037 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:08,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 16:15:08,039 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 16:15:08,039 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 16:15:08,039 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 16:15:08,039 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,040 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 16:15:08,040 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 16:15:08,039 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 16:15:08,040 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 16:15:08,040 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 16:15:08,041 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,042 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 16:15:08,042 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:08,045 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 16:15:08,045 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 16:15:08,045 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 16:15:08,046 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,046 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:08,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:08,046 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,046 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,047 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:08,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:08,047 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,047 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:08,048 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,048 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:08,048 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,048 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:08,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:08,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 16:15:08,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@317400cf[Count = 1] remaining members to acquire global barrier 2023-07-12 16:15:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:08,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:08,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 16:15:08,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@317400cf[Count = 0] remaining members to acquire global barrier 2023-07-12 16:15:08,052 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 16:15:08,052 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,055 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,055 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,055 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 16:15:08,055 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 16:15:08,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,055 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,055 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 16:15:08,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,056 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 16:15:08,056 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:08,056 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:08,056 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:08,055 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,41787,1689178459474' in zk 2023-07-12 16:15:08,056 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:08,056 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:08,055 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,056 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. started... 2023-07-12 16:15:08,056 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:08,056 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. started... 2023-07-12 16:15:08,058 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 116386608e3a603c3f43c73994f97085: 2023-07-12 16:15:08,058 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,058 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:15:08,058 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 969347d794042989f6cc45424b830328: 2023-07-12 16:15:08,058 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,058 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,058 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:08,059 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:15:08,060 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:08,060 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:15:08,062 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 16:15:08,062 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:08,062 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 16:15:08,075 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. completed. 2023-07-12 16:15:08,075 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:08,076 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:08,076 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:08,076 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,076 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 16:15:08,076 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,44777,1689178459404' in zk 2023-07-12 16:15:08,077 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 16:15:08,077 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,077 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:08,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:08,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:08,078 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 16:15:08,080 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. completed. 2023-07-12 16:15:08,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:08,080 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:08,080 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:08,080 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:08,080 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,080 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 16:15:08,080 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,43171,1689178459521' in zk 2023-07-12 16:15:08,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:08,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,083 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,083 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 16:15:08,083 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:08,083 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 16:15:08,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase5.apache.org,44777,1689178459404': 2023-07-12 16:15:08,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 16:15:08,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:08,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:08,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:08,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:08,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:08,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase5.apache.org,43171,1689178459521': 2023-07-12 16:15:08,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 16:15:08,092 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-12 16:15:08,092 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:15:08,092 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:15:08,092 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,092 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:15:08,094 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,094 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,094 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,094 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,094 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,094 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:08,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,095 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,095 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:08,095 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:08,096 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:08,098 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,099 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,099 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,102 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,103 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:08,103 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:08,103 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:08,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:08,103 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:08,103 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:08,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:08,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:08,103 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:08,103 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:08,103 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,103 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:08,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:08,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:08,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:08,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:08,103 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,103 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:08,107 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 16:15:08,104 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,107 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:08,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 16:15:08,107 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,109 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,109 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,109 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,109 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:08,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 16:15:08,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,184 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 16:15:08,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,185 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:08,185 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689178507932Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689178508125 (+193 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689178508125Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689178508126 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689178508129 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689178508149 (+20 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689178508184 (+35 ms) 2023-07-12 16:15:08,190 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 16:15:08,192 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 257 msec 2023-07-12 16:15:08,235 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:08,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 16:15:08,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:15:08,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43171] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:15:08,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44777] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:15:08,244 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 16:15:08,244 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:08,244 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:15:08,255 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 16:15:08,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178508255 (current time:1689178508255). 2023-07-12 16:15:08,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:15:08,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x6df61ff1 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:08,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34465087, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:08,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:08,271 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:56714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:08,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6df61ff1 to 127.0.0.1:53717 2023-07-12 16:15:08,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:08,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x69d78baf to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:08,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@348308f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:08,385 DEBUG [hconnection-0x32c7b48c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:08,388 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:56722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:08,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:08,393 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:08,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69d78baf to 127.0.0.1:53717 2023-07-12 16:15:08,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:08,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 16:15:08,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:15:08,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 16:15:08,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 16:15:08,398 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 16:15:08,399 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689179108399 2023-07-12 16:15:08,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 16:15:08,399 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 16:15:08,400 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:15:08,400 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:15:08,401 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 16:15:08,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 16:15:08,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 4 msec 2023-07-12 16:15:08,403 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 16:15:08,404 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689179108404 2023-07-12 16:15:08,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-12 16:15:08,413 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-12 16:15:08,413 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:08,415 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 16:15:08,415 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 16:15:08,415 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,415 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,416 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,416 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:08,416 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:08,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:08,416 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:08,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:08,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:08,417 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,417 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:08,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,417 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,418 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:15:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 16:15:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,418 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 16:15:08,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 16:15:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 16:15:08,418 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 16:15:08,418 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 16:15:08,418 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 16:15:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,420 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 16:15:08,420 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 16:15:08,420 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 16:15:08,419 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 16:15:08,420 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 16:15:08,420 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 16:15:08,420 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 16:15:08,420 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:08,420 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 16:15:08,421 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 16:15:08,421 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 16:15:08,421 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 16:15:08,421 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:08,422 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 16:15:08,422 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 16:15:08,422 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 16:15:08,424 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,424 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:08,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:08,424 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,424 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,425 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:08,425 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,425 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:08,425 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,425 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:08,425 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:08,425 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:08,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:08,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:08,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 16:15:08,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23bd6371[Count = 1] remaining members to acquire global barrier 2023-07-12 16:15:08,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:08,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:08,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:08,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:08,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:08,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:08,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 16:15:08,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23bd6371[Count = 0] remaining members to acquire global barrier 2023-07-12 16:15:08,429 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 16:15:08,429 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,432 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,432 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,432 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,433 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 16:15:08,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,433 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,433 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 16:15:08,433 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:08,433 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:08,433 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:08,433 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. started... 2023-07-12 16:15:08,433 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 16:15:08,433 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:08,433 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,433 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:15:08,433 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 16:15:08,433 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:08,433 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 969347d794042989f6cc45424b830328 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 16:15:08,433 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:08,433 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,41787,1689178459474' in zk 2023-07-12 16:15:08,433 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. started... 2023-07-12 16:15:08,434 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 116386608e3a603c3f43c73994f97085 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 16:15:08,436 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 16:15:08,436 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:08,436 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 16:15:08,472 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307122187272ff575486d8b3a6c23bc0ef6a9 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307122187272ff575486d8b3a6c23bc0ef6a9 2023-07-12 16:15:08,472 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307124f7cdaf835e94bcfa5576e0743e802a9 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307124f7cdaf835e94bcfa5576e0743e802a9 2023-07-12 16:15:08,484 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/.tmp/cf/69aaff0216a04cfb86a15f87defc8f85 2023-07-12 16:15:08,487 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/.tmp/cf/8613edd12c394a619eac7ad782612c7e 2023-07-12 16:15:08,493 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/.tmp/cf/8613edd12c394a619eac7ad782612c7e as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/cf/8613edd12c394a619eac7ad782612c7e 2023-07-12 16:15:08,494 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/.tmp/cf/69aaff0216a04cfb86a15f87defc8f85 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/cf/69aaff0216a04cfb86a15f87defc8f85 2023-07-12 16:15:08,498 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/cf/8613edd12c394a619eac7ad782612c7e, entries=3, sequenceid=6, filesize=5.4 K 2023-07-12 16:15:08,499 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/cf/69aaff0216a04cfb86a15f87defc8f85, entries=47, sequenceid=6, filesize=12.7 K 2023-07-12 16:15:08,499 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 116386608e3a603c3f43c73994f97085 in 65ms, sequenceid=6, compaction requested=false 2023-07-12 16:15:08,499 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 16:15:08,500 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 969347d794042989f6cc45424b830328 in 67ms, sequenceid=6, compaction requested=false 2023-07-12 16:15:08,500 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 16:15:08,502 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 969347d794042989f6cc45424b830328: 2023-07-12 16:15:08,502 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:08,502 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 16:15:08,502 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 116386608e3a603c3f43c73994f97085: 2023-07-12 16:15:08,502 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:08,502 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/cf/69aaff0216a04cfb86a15f87defc8f85] hfiles 2023-07-12 16:15:08,502 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/cf/69aaff0216a04cfb86a15f87defc8f85 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 16:15:08,502 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 16:15:08,502 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:08,502 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/cf/8613edd12c394a619eac7ad782612c7e] hfiles 2023-07-12 16:15:08,502 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/cf/8613edd12c394a619eac7ad782612c7e for snapshot=snaptb0-testConsecutiveExports 2023-07-12 16:15:08,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 16:15:08,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:08,503 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:15:08,523 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. completed. 2023-07-12 16:15:08,523 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:08,523 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:08,523 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:08,523 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,523 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 16:15:08,523 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. completed. 2023-07-12 16:15:08,523 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:08,523 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,44777,1689178459404' in zk 2023-07-12 16:15:08,523 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:08,523 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:08,523 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,523 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 16:15:08,523 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase5.apache.org,43171,1689178459521' in zk 2023-07-12 16:15:08,525 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 16:15:08,525 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,525 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:08,525 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 16:15:08,526 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 16:15:08,526 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,526 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:08,527 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 16:15:08,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:08,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:08,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase5.apache.org,44777,1689178459404': 2023-07-12 16:15:08,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 16:15:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase5.apache.org,43171,1689178459521': 2023-07-12 16:15:08,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 16:15:08,535 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-12 16:15:08,535 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:15:08,535 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:15:08,535 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-12 16:15:08,535 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:15:08,537 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,537 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:08,537 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,537 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,537 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:08,537 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:08,537 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:08,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:08,537 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:08,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:08,538 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,539 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:08,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:08,540 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 16:15:08,541 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,541 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,549 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:08,549 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:08,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:08,549 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:08,549 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:08,549 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:08,549 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,549 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:08,549 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:08,549 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:08,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:08,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:08,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-12 16:15:08,549 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:08,551 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:08,551 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 16:15:08,551 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,552 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:08,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 16:15:08,552 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 16:15:08,552 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:08,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:08,552 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:08,552 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,552 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307122187272ff575486d8b3a6c23bc0ef6a9, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307124f7cdaf835e94bcfa5576e0743e802a9] mob files 2023-07-12 16:15:08,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307122187272ff575486d8b3a6c23bc0ef6a9 2023-07-12 16:15:08,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307124f7cdaf835e94bcfa5576e0743e802a9 2023-07-12 16:15:08,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-12 16:15:08,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,603 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 16:15:08,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,603 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689178508399Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689178508567 (+168 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689178508567Loading Region manifests for snaptb0-testConsecutiveExports at 1689178508567Writing data manifest for snaptb0-testConsecutiveExports at 1689178508571 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689178508578 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689178508603 (+25 ms) 2023-07-12 16:15:08,606 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 16:15:08,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 206 msec 2023-07-12 16:15:08,703 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:08,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 16:15:08,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:15:08,705 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705 2023-07-12 16:15:08,705 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705, srcFsUri=hdfs://localhost:46851, srcDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:15:08,728 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:15:08,728 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7ebbd9e0, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,729 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756, snapshotDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 16:15:08,738 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:08,755 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:08,756 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:08,756 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:08,757 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:09,661 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-6361662690809835544.jar 2023-07-12 16:15:09,662 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:09,662 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:09,728 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-1124200055829713202.jar 2023-07-12 16:15:09,729 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:09,729 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:09,729 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:09,730 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:09,730 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:09,731 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:09,731 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:15:09,732 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:15:09,732 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:15:09,732 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:15:09,733 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:15:09,733 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:15:09,733 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:15:09,734 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:15:09,734 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:15:09,735 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:15:09,735 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:09,736 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:09,738 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:09,738 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:09,738 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:09,739 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:09,739 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:10,210 WARN [Listener at jenkins-hbase5.apache.org/37867] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:15:10,213 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 16:15:10,215 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 16:15:11,483 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:15:11,484 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:15:11,488 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0002_000001 (auth:SIMPLE) 2023-07-12 16:15:12,354 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0003_000001 (auth:SIMPLE) 2023-07-12 16:15:12,522 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:15:16,764 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0003_000001 (auth:SIMPLE) 2023-07-12 16:15:19,000 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0003_000001 (auth:SIMPLE) 2023-07-12 16:15:21,381 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0003_000001 (auth:SIMPLE) 2023-07-12 16:15:23,417 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:15:23,418 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:15:23,422 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 16:15:23,422 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:15:23,423 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:15:23,423 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-454504975_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 16:15:23,425 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 16:15:23,425 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 16:15:23,425 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@18167f6f in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 16:15:23,425 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 16:15:23,426 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 16:15:23,427 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705, srcFsUri=hdfs://localhost:46851, srcDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:15:23,452 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:15:23,452 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@583cf585, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:23,452 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756, snapshotDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 16:15:23,463 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 16:15:23,474 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:23,474 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:23,475 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:23,475 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:24,349 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-5879903973580100259.jar 2023-07-12 16:15:24,350 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:24,350 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:24,419 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-5410769119425506840.jar 2023-07-12 16:15:24,420 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:24,420 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:24,421 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:24,421 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:24,421 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:24,422 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:24,422 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:15:24,422 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:15:24,423 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:15:24,423 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:15:24,423 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:15:24,424 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:15:24,424 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:15:24,425 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:15:24,425 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:15:24,425 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:15:24,426 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:24,426 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:24,427 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:24,427 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:24,427 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:24,428 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:24,429 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:24,786 WARN [Listener at jenkins-hbase5.apache.org/37867] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:15:24,789 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 16:15:24,791 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 16:15:27,575 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:15:27,575 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:15:27,578 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0003_000001 (auth:SIMPLE) 2023-07-12 16:15:28,500 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0004_000001 (auth:SIMPLE) 2023-07-12 16:15:32,913 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0004_000001 (auth:SIMPLE) 2023-07-12 16:15:35,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0004_000001 (auth:SIMPLE) 2023-07-12 16:15:38,557 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0004_000001 (auth:SIMPLE) 2023-07-12 16:15:40,016 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:15:40,016 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:15:40,022 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 16:15:40,022 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:15:40,022 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:15:40,022 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-454504975_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 16:15:40,025 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 16:15:40,025 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 16:15:40,025 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@18167f6f in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 16:15:40,026 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 16:15:40,026 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/local-export-1689178508705/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 16:15:40,043 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-12 16:15:40,044 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testConsecutiveExports 2023-07-12 16:15:40,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:40,052 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178540052"}]},"ts":"1689178540052"} 2023-07-12 16:15:40,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 16:15:40,055 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-12 16:15:40,057 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-12 16:15:40,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=116386608e3a603c3f43c73994f97085, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=969347d794042989f6cc45424b830328, UNASSIGN}] 2023-07-12 16:15:40,060 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=116386608e3a603c3f43c73994f97085, UNASSIGN 2023-07-12 16:15:40,063 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=969347d794042989f6cc45424b830328, UNASSIGN 2023-07-12 16:15:40,065 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=116386608e3a603c3f43c73994f97085, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:40,066 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178540065"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178540065"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178540065"}]},"ts":"1689178540065"} 2023-07-12 16:15:40,066 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=969347d794042989f6cc45424b830328, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:40,066 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178540066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178540066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178540066"}]},"ts":"1689178540066"} 2023-07-12 16:15:40,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 116386608e3a603c3f43c73994f97085, server=jenkins-hbase5.apache.org,43171,1689178459521}] 2023-07-12 16:15:40,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 969347d794042989f6cc45424b830328, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:15:40,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 16:15:40,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 116386608e3a603c3f43c73994f97085 2023-07-12 16:15:40,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 116386608e3a603c3f43c73994f97085, disabling compactions & flushes 2023-07-12 16:15:40,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:40,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:40,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. after waiting 0 ms 2023-07-12 16:15:40,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:40,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 969347d794042989f6cc45424b830328 2023-07-12 16:15:40,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 969347d794042989f6cc45424b830328, disabling compactions & flushes 2023-07-12 16:15:40,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:40,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:40,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. after waiting 0 ms 2023-07-12 16:15:40,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:40,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:15:40,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:15:40,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:15:40,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085. 2023-07-12 16:15:40,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 116386608e3a603c3f43c73994f97085: 2023-07-12 16:15:40,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:15:40,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328. 2023-07-12 16:15:40,275 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 969347d794042989f6cc45424b830328: 2023-07-12 16:15:40,277 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=116386608e3a603c3f43c73994f97085, regionState=CLOSED 2023-07-12 16:15:40,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 116386608e3a603c3f43c73994f97085 2023-07-12 16:15:40,278 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178540277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178540277"}]},"ts":"1689178540277"} 2023-07-12 16:15:40,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 969347d794042989f6cc45424b830328 2023-07-12 16:15:40,284 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=969347d794042989f6cc45424b830328, regionState=CLOSED 2023-07-12 16:15:40,284 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689178540284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178540284"}]},"ts":"1689178540284"} 2023-07-12 16:15:40,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-12 16:15:40,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 116386608e3a603c3f43c73994f97085, server=jenkins-hbase5.apache.org,43171,1689178459521 in 217 msec 2023-07-12 16:15:40,289 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-12 16:15:40,289 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 969347d794042989f6cc45424b830328, server=jenkins-hbase5.apache.org,44777,1689178459404 in 215 msec 2023-07-12 16:15:40,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=116386608e3a603c3f43c73994f97085, UNASSIGN in 230 msec 2023-07-12 16:15:40,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-12 16:15:40,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=969347d794042989f6cc45424b830328, UNASSIGN in 231 msec 2023-07-12 16:15:40,293 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178540293"}]},"ts":"1689178540293"} 2023-07-12 16:15:40,297 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-12 16:15:40,298 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-12 16:15:40,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 256 msec 2023-07-12 16:15:40,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 16:15:40,359 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-12 16:15:40,360 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testConsecutiveExports 2023-07-12 16:15:40,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:40,364 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:40,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-12 16:15:40,367 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-12 16:15:40,368 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:40,371 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:40,371 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:40,371 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:40,379 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:40,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 16:15:40,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 16:15:40,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 16:15:40,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 16:15:40,384 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:40,384 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:40,385 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:40,385 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:40,385 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:40,385 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:40,385 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 16:15:40,385 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:40,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 16:15:40,395 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085 2023-07-12 16:15:40,396 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328 2023-07-12 16:15:40,398 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/recovered.edits] 2023-07-12 16:15:40,399 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/recovered.edits] 2023-07-12 16:15:40,413 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/cf/69aaff0216a04cfb86a15f87defc8f85 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/cf/69aaff0216a04cfb86a15f87defc8f85 2023-07-12 16:15:40,413 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/cf/8613edd12c394a619eac7ad782612c7e to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/cf/8613edd12c394a619eac7ad782612c7e 2023-07-12 16:15:40,420 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/recovered.edits/9.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328/recovered.edits/9.seqid 2023-07-12 16:15:40,420 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/recovered.edits/9.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085/recovered.edits/9.seqid 2023-07-12 16:15:40,420 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/969347d794042989f6cc45424b830328 2023-07-12 16:15:40,420 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testConsecutiveExports/116386608e3a603c3f43c73994f97085 2023-07-12 16:15:40,420 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 16:15:40,421 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 16:15:40,422 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-12 16:15:40,428 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307122187272ff575486d8b3a6c23bc0ef6a9 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307122187272ff575486d8b3a6c23bc0ef6a9 2023-07-12 16:15:40,430 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307124f7cdaf835e94bcfa5576e0743e802a9 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307124f7cdaf835e94bcfa5576e0743e802a9 2023-07-12 16:15:40,431 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 16:15:40,434 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:40,437 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-12 16:15:40,447 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-12 16:15:40,449 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:40,450 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-12 16:15:40,450 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178540450"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:40,450 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178540450"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:40,458 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 16:15:40,458 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 116386608e3a603c3f43c73994f97085, NAME => 'testtb-testConsecutiveExports,,1689178507269.116386608e3a603c3f43c73994f97085.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 969347d794042989f6cc45424b830328, NAME => 'testtb-testConsecutiveExports,1,1689178507269.969347d794042989f6cc45424b830328.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 16:15:40,459 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-12 16:15:40,459 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178540459"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:40,463 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-12 16:15:40,466 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 16:15:40,468 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 106 msec 2023-07-12 16:15:40,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 16:15:40,488 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-12 16:15:40,503 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-12 16:15:40,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-12 16:15:40,511 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-12 16:15:40,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-12 16:15:40,547 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=742 (was 762), OpenFileDescriptor=893 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=418 (was 374) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=4120 (was 4160) 2023-07-12 16:15:40,547 WARN [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(130): Thread=742 is superior to 500 2023-07-12 16:15:40,575 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=742, OpenFileDescriptor=893, MaxFileDescriptor=60000, SystemLoadAverage=418, ProcessCount=170, AvailableMemoryMB=4117 2023-07-12 16:15:40,575 WARN [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(130): Thread=742 is superior to 500 2023-07-12 16:15:40,578 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 16:15:40,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:40,582 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:15:40,583 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-12 16:15:40,583 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:15:40,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 16:15:40,597 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6 2023-07-12 16:15:40,598 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6 empty. 2023-07-12 16:15:40,599 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6 2023-07-12 16:15:40,631 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449 2023-07-12 16:15:40,632 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449 empty. 2023-07-12 16:15:40,632 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449 2023-07-12 16:15:40,633 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 16:15:40,688 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-12 16:15:40,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 16:15:40,690 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 71c5dfd554a07fec39b10adc358070b6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:15:40,692 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 883c226c1b93beabb72803b09c42c449, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:15:40,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:40,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 71c5dfd554a07fec39b10adc358070b6, disabling compactions & flushes 2023-07-12 16:15:40,736 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:15:40,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:15:40,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. after waiting 0 ms 2023-07-12 16:15:40,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:15:40,736 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:15:40,736 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 71c5dfd554a07fec39b10adc358070b6: 2023-07-12 16:15:40,738 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:40,738 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 883c226c1b93beabb72803b09c42c449, disabling compactions & flushes 2023-07-12 16:15:40,739 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:15:40,739 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:15:40,739 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. after waiting 0 ms 2023-07-12 16:15:40,739 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:15:40,739 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:15:40,739 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 883c226c1b93beabb72803b09c42c449: 2023-07-12 16:15:40,742 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:15:40,743 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178540743"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178540743"}]},"ts":"1689178540743"} 2023-07-12 16:15:40,743 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178540743"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178540743"}]},"ts":"1689178540743"} 2023-07-12 16:15:40,760 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:15:40,762 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:15:40,762 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178540762"}]},"ts":"1689178540762"} 2023-07-12 16:15:40,764 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-12 16:15:40,768 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:15:40,770 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:15:40,770 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:15:40,770 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:15:40,770 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:15:40,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71c5dfd554a07fec39b10adc358070b6, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=883c226c1b93beabb72803b09c42c449, ASSIGN}] 2023-07-12 16:15:40,774 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=883c226c1b93beabb72803b09c42c449, ASSIGN 2023-07-12 16:15:40,775 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71c5dfd554a07fec39b10adc358070b6, ASSIGN 2023-07-12 16:15:40,776 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71c5dfd554a07fec39b10adc358070b6, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41787,1689178459474; forceNewPlan=false, retain=false 2023-07-12 16:15:40,776 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=883c226c1b93beabb72803b09c42c449, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,43171,1689178459521; forceNewPlan=false, retain=false 2023-07-12 16:15:40,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 16:15:40,926 INFO [jenkins-hbase5:43373] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:15:40,930 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=883c226c1b93beabb72803b09c42c449, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:40,930 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178540930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178540930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178540930"}]},"ts":"1689178540930"} 2023-07-12 16:15:40,931 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=71c5dfd554a07fec39b10adc358070b6, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:40,931 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178540931"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178540931"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178540931"}]},"ts":"1689178540931"} 2023-07-12 16:15:40,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 883c226c1b93beabb72803b09c42c449, server=jenkins-hbase5.apache.org,43171,1689178459521}] 2023-07-12 16:15:40,940 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 71c5dfd554a07fec39b10adc358070b6, server=jenkins-hbase5.apache.org,41787,1689178459474}] 2023-07-12 16:15:41,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:15:41,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 883c226c1b93beabb72803b09c42c449, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 16:15:41,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. service=AccessControlService 2023-07-12 16:15:41,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:41,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 883c226c1b93beabb72803b09c42c449 2023-07-12 16:15:41,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:41,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 883c226c1b93beabb72803b09c42c449 2023-07-12 16:15:41,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 883c226c1b93beabb72803b09c42c449 2023-07-12 16:15:41,113 INFO [StoreOpener-883c226c1b93beabb72803b09c42c449-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 883c226c1b93beabb72803b09c42c449 2023-07-12 16:15:41,117 DEBUG [StoreOpener-883c226c1b93beabb72803b09c42c449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/cf 2023-07-12 16:15:41,117 DEBUG [StoreOpener-883c226c1b93beabb72803b09c42c449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/cf 2023-07-12 16:15:41,118 INFO [StoreOpener-883c226c1b93beabb72803b09c42c449-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 883c226c1b93beabb72803b09c42c449 columnFamilyName cf 2023-07-12 16:15:41,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:15:41,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 71c5dfd554a07fec39b10adc358070b6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 16:15:41,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. service=AccessControlService 2023-07-12 16:15:41,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:41,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 71c5dfd554a07fec39b10adc358070b6 2023-07-12 16:15:41,120 INFO [StoreOpener-883c226c1b93beabb72803b09c42c449-1] regionserver.HStore(310): Store=883c226c1b93beabb72803b09c42c449/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:41,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:41,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 71c5dfd554a07fec39b10adc358070b6 2023-07-12 16:15:41,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 71c5dfd554a07fec39b10adc358070b6 2023-07-12 16:15:41,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449 2023-07-12 16:15:41,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449 2023-07-12 16:15:41,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 883c226c1b93beabb72803b09c42c449 2023-07-12 16:15:41,126 INFO [StoreOpener-71c5dfd554a07fec39b10adc358070b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 71c5dfd554a07fec39b10adc358070b6 2023-07-12 16:15:41,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:15:41,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 883c226c1b93beabb72803b09c42c449; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62057978, jitterRate=-0.07526406645774841}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:41,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 883c226c1b93beabb72803b09c42c449: 2023-07-12 16:15:41,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449., pid=60, masterSystemTime=1689178541093 2023-07-12 16:15:41,135 DEBUG [StoreOpener-71c5dfd554a07fec39b10adc358070b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/cf 2023-07-12 16:15:41,135 DEBUG [StoreOpener-71c5dfd554a07fec39b10adc358070b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/cf 2023-07-12 16:15:41,136 INFO [StoreOpener-71c5dfd554a07fec39b10adc358070b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 71c5dfd554a07fec39b10adc358070b6 columnFamilyName cf 2023-07-12 16:15:41,144 INFO [StoreOpener-71c5dfd554a07fec39b10adc358070b6-1] regionserver.HStore(310): Store=71c5dfd554a07fec39b10adc358070b6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:41,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:15:41,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:15:41,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6 2023-07-12 16:15:41,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6 2023-07-12 16:15:41,149 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=883c226c1b93beabb72803b09c42c449, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:41,149 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178541149"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178541149"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178541149"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178541149"}]},"ts":"1689178541149"} 2023-07-12 16:15:41,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 71c5dfd554a07fec39b10adc358070b6 2023-07-12 16:15:41,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:15:41,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 71c5dfd554a07fec39b10adc358070b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67661817, jitterRate=0.008239641785621643}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:41,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 71c5dfd554a07fec39b10adc358070b6: 2023-07-12 16:15:41,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6., pid=61, masterSystemTime=1689178541099 2023-07-12 16:15:41,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:15:41,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:15:41,160 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-12 16:15:41,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 883c226c1b93beabb72803b09c42c449, server=jenkins-hbase5.apache.org,43171,1689178459521 in 220 msec 2023-07-12 16:15:41,161 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=71c5dfd554a07fec39b10adc358070b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:41,161 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178541161"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178541161"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178541161"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178541161"}]},"ts":"1689178541161"} 2023-07-12 16:15:41,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=883c226c1b93beabb72803b09c42c449, ASSIGN in 391 msec 2023-07-12 16:15:41,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-12 16:15:41,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 71c5dfd554a07fec39b10adc358070b6, server=jenkins-hbase5.apache.org,41787,1689178459474 in 224 msec 2023-07-12 16:15:41,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-12 16:15:41,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71c5dfd554a07fec39b10adc358070b6, ASSIGN in 397 msec 2023-07-12 16:15:41,171 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:15:41,171 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178541171"}]},"ts":"1689178541171"} 2023-07-12 16:15:41,174 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-12 16:15:41,187 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:15:41,188 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-12 16:15:41,191 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 16:15:41,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 16:15:41,197 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:41,197 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:41,197 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:41,197 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:41,200 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:41,201 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:41,204 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:41,204 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:41,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 622 msec 2023-07-12 16:15:41,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 16:15:41,693 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-12 16:15:41,695 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:41,695 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:15:41,698 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:15:41,712 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 16:15:41,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178541712 (current time:1689178541712). 2023-07-12 16:15:41,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:15:41,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x4230fe7e to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:41,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bd36d3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:41,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:41,749 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:60442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:41,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4230fe7e to 127.0.0.1:53717 2023-07-12 16:15:41,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:41,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x2a86d8e5 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:41,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f0010c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:41,810 DEBUG [hconnection-0x7f2a229d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:41,811 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:60444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:41,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:41,819 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:54656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:41,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a86d8e5 to 127.0.0.1:53717 2023-07-12 16:15:41,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:41,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 16:15:41,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:15:41,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 16:15:41,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 16:15:41,865 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 16:15:41,866 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689179141866 2023-07-12 16:15:41,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 16:15:41,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:41,869 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:15:41,870 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:15:41,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 16:15:41,876 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 16:15:41,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 14 msec 2023-07-12 16:15:41,933 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 16:15:41,934 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689179141934 2023-07-12 16:15:41,971 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:41,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 16:15:41,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:41,973 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:15:42,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,091 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 16:15:42,091 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:42,091 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 16:15:42,091 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 16:15:42,092 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,092 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,111 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:42,111 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:42,111 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:42,111 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:42,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:42,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:42,112 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,112 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,112 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,112 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:15:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 16:15:42,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,113 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 16:15:42,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 16:15:42,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,113 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,113 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 16:15:42,113 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 16:15:42,113 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:42,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 16:15:42,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,114 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 16:15:42,114 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,114 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 16:15:42,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,115 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 16:15:42,116 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 16:15:42,116 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:42,115 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:42,117 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 16:15:42,117 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 16:15:42,116 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 16:15:42,118 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 16:15:42,118 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 16:15:42,118 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 16:15:42,118 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 16:15:42,118 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 16:15:42,173 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,173 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,173 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:42,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:42,174 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:42,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 16:15:42,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:42,175 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 16:15:42,189 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,189 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,189 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:42,189 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,190 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:42,189 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:42,190 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:42,190 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:42,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 16:15:42,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48279d17[Count = 1] remaining members to acquire global barrier 2023-07-12 16:15:42,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:42,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:42,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:42,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:42,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:42,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 16:15:42,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48279d17[Count = 0] remaining members to acquire global barrier 2023-07-12 16:15:42,195 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 16:15:42,195 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,211 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,211 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,211 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,212 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 16:15:42,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,212 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,212 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 16:15:42,212 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 16:15:42,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,212 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,44777,1689178459404' in zk 2023-07-12 16:15:42,212 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 16:15:42,212 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:42,212 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:42,212 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:15:42,212 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:42,212 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:42,212 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,213 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:15:42,212 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:15:42,212 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. started... 2023-07-12 16:15:42,213 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. started... 2023-07-12 16:15:42,213 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 71c5dfd554a07fec39b10adc358070b6: 2023-07-12 16:15:42,214 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 883c226c1b93beabb72803b09c42c449: 2023-07-12 16:15:42,214 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,214 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,214 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:42,215 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:42,215 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:15:42,215 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:15:42,301 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 16:15:42,302 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:42,302 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 16:15:42,303 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. completed. 2023-07-12 16:15:42,303 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:15:42,308 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:42,308 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:42,308 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,309 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 16:15:42,309 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,41787,1689178459474' in zk 2023-07-12 16:15:42,365 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 16:15:42,365 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,365 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:42,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:42,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:42,365 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 16:15:42,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:42,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:42,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,370 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. completed. 2023-07-12 16:15:42,370 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:15:42,371 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:42,371 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:42,371 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,371 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 16:15:42,371 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,43171,1689178459521' in zk 2023-07-12 16:15:42,396 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 16:15:42,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:42,396 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,396 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:42,396 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 16:15:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase5.apache.org,41787,1689178459474': 2023-07-12 16:15:42,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 16:15:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:42,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase5.apache.org,43171,1689178459521': 2023-07-12 16:15:42,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 16:15:42,404 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 16:15:42,404 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:15:42,404 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:15:42,404 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,405 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:15:42,419 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,419 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,419 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,419 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:42,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,419 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:42,419 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:42,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:42,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:42,420 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:42,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:42,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:42,420 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:42,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:42,422 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,422 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:42,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,427 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:42,427 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,428 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:42,473 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,473 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,473 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,473 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:42,473 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:42,473 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:42,473 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:42,473 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,473 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:42,473 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,473 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:42,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,474 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:42,473 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,473 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:42,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:42,474 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 16:15:42,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:42,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:42,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:42,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:42,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:42,476 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,477 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:42,477 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:42,477 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,477 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:42,475 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:42,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:42,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:42,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-12 16:15:42,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:42,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:42,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 16:15:42,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 16:15:42,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:42,479 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 16:15:42,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,839 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 16:15:42,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,840 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689178541867Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689178542633 (+766 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689178542633Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689178542633Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689178542640 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689178542775 (+135 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689178542839 (+64 ms) 2023-07-12 16:15:42,844 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 16:15:42,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 976 msec 2023-07-12 16:15:42,979 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:42,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 16:15:42,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:15:42,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41787] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:15:42,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43171] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:15:42,986 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:42,986 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:15:42,987 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:15:42,998 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 16:15:42,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178542998 (current time:1689178542998). 2023-07-12 16:15:42,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:15:42,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x23239fa2 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:43,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6650db80, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:43,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:43,012 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:60456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:43,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23239fa2 to 127.0.0.1:53717 2023-07-12 16:15:43,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:43,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x440eb3b1 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:43,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b6ffa1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:43,022 DEBUG [hconnection-0x1b83a22b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:43,026 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:60462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:43,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:43,032 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:54672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:43,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x440eb3b1 to 127.0.0.1:53717 2023-07-12 16:15:43,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:43,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 16:15:43,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:15:43,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 16:15:43,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 16:15:43,038 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 16:15:43,039 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689179143039 2023-07-12 16:15:43,039 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 16:15:43,040 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:15:43,040 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:15:43,041 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 16:15:43,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 16:15:43,042 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-12 16:15:43,043 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 16:15:43,044 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689179143044 2023-07-12 16:15:43,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,062 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 16:15:43,062 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:43,064 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 16:15:43,064 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 16:15:43,064 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,064 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,066 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:43,066 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:43,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:43,066 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:43,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:43,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:43,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:43,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:43,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:43,067 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,071 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,072 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,072 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,072 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:15:43,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 16:15:43,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 16:15:43,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,073 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 16:15:43,073 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 16:15:43,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,073 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 16:15:43,073 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:43,073 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 16:15:43,073 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:43,075 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 16:15:43,075 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 16:15:43,075 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 16:15:43,076 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 16:15:43,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,076 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 16:15:43,077 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 16:15:43,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,078 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,078 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 16:15:43,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 16:15:43,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,083 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 16:15:43,083 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:43,085 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 16:15:43,085 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 16:15:43,085 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 16:15:43,086 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,086 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,086 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,086 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:43,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:43,087 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,087 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:43,099 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,100 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,100 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:43,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:43,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:43,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 16:15:43,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c1d18be[Count = 1] remaining members to acquire global barrier 2023-07-12 16:15:43,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:43,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:43,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:43,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:43,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:43,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:43,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 16:15:43,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c1d18be[Count = 0] remaining members to acquire global barrier 2023-07-12 16:15:43,108 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 16:15:43,108 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,110 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,110 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,110 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,110 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,110 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 16:15:43,110 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 16:15:43,110 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 16:15:43,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,110 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,110 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:15:43,110 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,44777,1689178459404' in zk 2023-07-12 16:15:43,110 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:43,111 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:15:43,111 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,111 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. started... 2023-07-12 16:15:43,111 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 16:15:43,111 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 71c5dfd554a07fec39b10adc358070b6 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-12 16:15:43,111 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:43,111 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:43,111 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:15:43,111 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. started... 2023-07-12 16:15:43,118 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 883c226c1b93beabb72803b09c42c449 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-12 16:15:43,119 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 16:15:43,119 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:43,119 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 16:15:43,140 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:43,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 16:15:43,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:43,142 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:15:43,161 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307124a64b71839364e82a08ac397f992e783 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307124a64b71839364e82a08ac397f992e783 2023-07-12 16:15:43,169 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712863bc1d3edeb4afc9db7cb9d08c0ba47 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712863bc1d3edeb4afc9db7cb9d08c0ba47 2023-07-12 16:15:43,186 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/.tmp/cf/083e3fe9ba33463fa73d481875f96302 2023-07-12 16:15:43,187 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/.tmp/cf/ed1afe704ab240dd80f83640a7f30733 2023-07-12 16:15:43,195 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/.tmp/cf/ed1afe704ab240dd80f83640a7f30733 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/cf/ed1afe704ab240dd80f83640a7f30733 2023-07-12 16:15:43,197 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/.tmp/cf/083e3fe9ba33463fa73d481875f96302 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/cf/083e3fe9ba33463fa73d481875f96302 2023-07-12 16:15:43,201 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/cf/ed1afe704ab240dd80f83640a7f30733, entries=48, sequenceid=6, filesize=13.7 K 2023-07-12 16:15:43,201 INFO [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 883c226c1b93beabb72803b09c42c449 in 89ms, sequenceid=6, compaction requested=false 2023-07-12 16:15:43,202 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-12 16:15:43,202 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 883c226c1b93beabb72803b09c42c449: 2023-07-12 16:15:43,202 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,202 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:43,202 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/cf/ed1afe704ab240dd80f83640a7f30733] hfiles 2023-07-12 16:15:43,202 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/cf/ed1afe704ab240dd80f83640a7f30733 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,203 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/cf/083e3fe9ba33463fa73d481875f96302, entries=2, sequenceid=6, filesize=5.3 K 2023-07-12 16:15:43,204 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 71c5dfd554a07fec39b10adc358070b6 in 93ms, sequenceid=6, compaction requested=false 2023-07-12 16:15:43,209 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 71c5dfd554a07fec39b10adc358070b6: 2023-07-12 16:15:43,209 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,209 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:43,209 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/cf/083e3fe9ba33463fa73d481875f96302] hfiles 2023-07-12 16:15:43,209 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/cf/083e3fe9ba33463fa73d481875f96302 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,231 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. completed. 2023-07-12 16:15:43,231 DEBUG [rs(jenkins-hbase5.apache.org,43171,1689178459521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:15:43,231 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:43,232 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:43,232 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,232 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 16:15:43,232 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,43171,1689178459521' in zk 2023-07-12 16:15:43,234 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,234 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 16:15:43,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:43,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:43,234 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:43,234 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 16:15:43,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:43,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:43,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:43,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:43,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:43,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,245 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. completed. 2023-07-12 16:15:43,245 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:15:43,245 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:43,245 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:43,245 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,245 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 16:15:43,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase5.apache.org,43171,1689178459521': 2023-07-12 16:15:43,245 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase5.apache.org,41787,1689178459474' in zk 2023-07-12 16:15:43,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 16:15:43,248 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,248 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 16:15:43,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:43,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:43,248 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:43,249 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 16:15:43,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:43,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:43,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:43,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:43,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:43,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase5.apache.org,41787,1689178459474': 2023-07-12 16:15:43,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 16:15:43,254 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 16:15:43,254 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:15:43,254 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:15:43,254 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,254 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:15:43,259 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,259 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,260 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:43,259 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:43,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:43,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:43,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:43,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:43,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,263 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,263 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:43,263 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:43,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:43,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:43,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:43,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:43,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,264 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:43,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,264 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:43,264 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:43,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:43,266 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:43,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,267 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:43,267 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,271 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:43,271 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:43,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:43,271 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:43,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:43,271 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:43,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:43,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:43,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:43,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:43,275 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:43,275 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:43,275 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:43,275 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:43,275 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,275 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:43,275 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,275 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:43,275 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,275 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,275 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,275 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:43,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:43,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,275 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:43,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 16:15:43,275 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:43,276 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,276 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307124a64b71839364e82a08ac397f992e783, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712863bc1d3edeb4afc9db7cb9d08c0ba47] mob files 2023-07-12 16:15:43,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307124a64b71839364e82a08ac397f992e783 2023-07-12 16:15:43,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712863bc1d3edeb4afc9db7cb9d08c0ba47 2023-07-12 16:15:43,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,342 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:43,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 16:15:43,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:43,343 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 16:15:43,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,412 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 16:15:43,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,413 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:15:43,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689178543039Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689178543307 (+268 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689178543307Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689178543307Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689178543324 (+17 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689178543375 (+51 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689178543412 (+37 ms) 2023-07-12 16:15:43,416 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 16:15:43,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 376 msec 2023-07-12 16:15:43,644 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:43,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 16:15:43,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:15:43,683 DEBUG [Listener at jenkins-hbase5.apache.org/37867] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 16:15:43,686 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:60468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 16:15:43,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41787] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 16:15:43,688 DEBUG [Listener at jenkins-hbase5.apache.org/37867] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 16:15:43,693 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:35176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 16:15:43,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43171] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 16:15:43,693 DEBUG [Listener at jenkins-hbase5.apache.org/37867] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 16:15:43,698 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:54680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 16:15:43,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44777] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 16:15:43,700 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 16:15:43,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:43,702 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:15:43,703 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-12 16:15:43,703 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:15:43,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 16:15:43,705 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:15:43,705 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569 2023-07-12 16:15:43,706 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0 empty. 2023-07-12 16:15:43,706 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569 empty. 2023-07-12 16:15:43,706 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569 2023-07-12 16:15:43,706 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:15:43,706 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 16:15:43,717 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-12 16:15:43,718 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 87151af4f2278cc5d26253cec51cd569, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:15:43,718 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => df93601fdb263771edb48a14ae0c5fa0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:15:43,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:43,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:43,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 87151af4f2278cc5d26253cec51cd569, disabling compactions & flushes 2023-07-12 16:15:43,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing df93601fdb263771edb48a14ae0c5fa0, disabling compactions & flushes 2023-07-12 16:15:43,727 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. 2023-07-12 16:15:43,727 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. 2023-07-12 16:15:43,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. 2023-07-12 16:15:43,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. 2023-07-12 16:15:43,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. after waiting 0 ms 2023-07-12 16:15:43,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. after waiting 0 ms 2023-07-12 16:15:43,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. 2023-07-12 16:15:43,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. 2023-07-12 16:15:43,727 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. 2023-07-12 16:15:43,727 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. 2023-07-12 16:15:43,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for df93601fdb263771edb48a14ae0c5fa0: 2023-07-12 16:15:43,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 87151af4f2278cc5d26253cec51cd569: 2023-07-12 16:15:43,729 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:15:43,730 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178543730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178543730"}]},"ts":"1689178543730"} 2023-07-12 16:15:43,730 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178543730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178543730"}]},"ts":"1689178543730"} 2023-07-12 16:15:43,732 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:15:43,733 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:15:43,733 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178543733"}]},"ts":"1689178543733"} 2023-07-12 16:15:43,734 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-12 16:15:43,737 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:15:43,738 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:15:43,738 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:15:43,738 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:15:43,738 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:15:43,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df93601fdb263771edb48a14ae0c5fa0, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87151af4f2278cc5d26253cec51cd569, ASSIGN}] 2023-07-12 16:15:43,741 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df93601fdb263771edb48a14ae0c5fa0, ASSIGN 2023-07-12 16:15:43,741 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87151af4f2278cc5d26253cec51cd569, ASSIGN 2023-07-12 16:15:43,741 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87151af4f2278cc5d26253cec51cd569, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41787,1689178459474; forceNewPlan=false, retain=false 2023-07-12 16:15:43,741 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df93601fdb263771edb48a14ae0c5fa0, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44777,1689178459404; forceNewPlan=false, retain=false 2023-07-12 16:15:43,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 16:15:43,892 INFO [jenkins-hbase5:43373] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:15:43,895 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=df93601fdb263771edb48a14ae0c5fa0, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:43,895 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=87151af4f2278cc5d26253cec51cd569, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:43,895 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178543895"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178543895"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178543895"}]},"ts":"1689178543895"} 2023-07-12 16:15:43,895 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178543895"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178543895"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178543895"}]},"ts":"1689178543895"} 2023-07-12 16:15:43,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure df93601fdb263771edb48a14ae0c5fa0, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:15:43,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 87151af4f2278cc5d26253cec51cd569, server=jenkins-hbase5.apache.org,41787,1689178459474}] 2023-07-12 16:15:44,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 16:15:44,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. 2023-07-12 16:15:44,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87151af4f2278cc5d26253cec51cd569, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 16:15:44,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. service=AccessControlService 2023-07-12 16:15:44,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:44,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 87151af4f2278cc5d26253cec51cd569 2023-07-12 16:15:44,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:44,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 87151af4f2278cc5d26253cec51cd569 2023-07-12 16:15:44,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 87151af4f2278cc5d26253cec51cd569 2023-07-12 16:15:44,056 INFO [StoreOpener-87151af4f2278cc5d26253cec51cd569-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 87151af4f2278cc5d26253cec51cd569 2023-07-12 16:15:44,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. 2023-07-12 16:15:44,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => df93601fdb263771edb48a14ae0c5fa0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0.', STARTKEY => '', ENDKEY => '2'} 2023-07-12 16:15:44,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. service=AccessControlService 2023-07-12 16:15:44,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:44,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:15:44,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:44,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:15:44,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:15:44,061 DEBUG [StoreOpener-87151af4f2278cc5d26253cec51cd569-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/cf 2023-07-12 16:15:44,061 DEBUG [StoreOpener-87151af4f2278cc5d26253cec51cd569-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/cf 2023-07-12 16:15:44,062 INFO [StoreOpener-87151af4f2278cc5d26253cec51cd569-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87151af4f2278cc5d26253cec51cd569 columnFamilyName cf 2023-07-12 16:15:44,062 INFO [StoreOpener-df93601fdb263771edb48a14ae0c5fa0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:15:44,062 INFO [StoreOpener-87151af4f2278cc5d26253cec51cd569-1] regionserver.HStore(310): Store=87151af4f2278cc5d26253cec51cd569/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:44,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569 2023-07-12 16:15:44,065 DEBUG [StoreOpener-df93601fdb263771edb48a14ae0c5fa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/cf 2023-07-12 16:15:44,065 DEBUG [StoreOpener-df93601fdb263771edb48a14ae0c5fa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/cf 2023-07-12 16:15:44,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569 2023-07-12 16:15:44,065 INFO [StoreOpener-df93601fdb263771edb48a14ae0c5fa0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df93601fdb263771edb48a14ae0c5fa0 columnFamilyName cf 2023-07-12 16:15:44,066 INFO [StoreOpener-df93601fdb263771edb48a14ae0c5fa0-1] regionserver.HStore(310): Store=df93601fdb263771edb48a14ae0c5fa0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:44,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:15:44,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:15:44,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 87151af4f2278cc5d26253cec51cd569 2023-07-12 16:15:44,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:15:44,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:15:44,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 87151af4f2278cc5d26253cec51cd569; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68553561, jitterRate=0.021527662873268127}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:44,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 87151af4f2278cc5d26253cec51cd569: 2023-07-12 16:15:44,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569., pid=70, masterSystemTime=1689178544049 2023-07-12 16:15:44,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:15:44,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened df93601fdb263771edb48a14ae0c5fa0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65527005, jitterRate=-0.02357153594493866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:44,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for df93601fdb263771edb48a14ae0c5fa0: 2023-07-12 16:15:44,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0., pid=69, masterSystemTime=1689178544049 2023-07-12 16:15:44,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. 2023-07-12 16:15:44,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. 2023-07-12 16:15:44,096 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=87151af4f2278cc5d26253cec51cd569, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:44,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. 2023-07-12 16:15:44,096 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178544096"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178544096"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178544096"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178544096"}]},"ts":"1689178544096"} 2023-07-12 16:15:44,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. 2023-07-12 16:15:44,098 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=df93601fdb263771edb48a14ae0c5fa0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:44,098 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178544098"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178544098"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178544098"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178544098"}]},"ts":"1689178544098"} 2023-07-12 16:15:44,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-12 16:15:44,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 87151af4f2278cc5d26253cec51cd569, server=jenkins-hbase5.apache.org,41787,1689178459474 in 201 msec 2023-07-12 16:15:44,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-12 16:15:44,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure df93601fdb263771edb48a14ae0c5fa0, server=jenkins-hbase5.apache.org,44777,1689178459404 in 203 msec 2023-07-12 16:15:44,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87151af4f2278cc5d26253cec51cd569, ASSIGN in 364 msec 2023-07-12 16:15:44,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-12 16:15:44,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df93601fdb263771edb48a14ae0c5fa0, ASSIGN in 365 msec 2023-07-12 16:15:44,108 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:15:44,108 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178544108"}]},"ts":"1689178544108"} 2023-07-12 16:15:44,110 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-12 16:15:44,112 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:15:44,113 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-12 16:15:44,115 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 16:15:44,118 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:44,118 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:44,118 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:44,118 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:15:44,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:44,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:44,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:44,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:44,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:44,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:44,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:44,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 16:15:44,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 420 msec 2023-07-12 16:15:44,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 16:15:44,308 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-12 16:15:44,337 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.HMaster$2(1952): Client=jenkins//172.31.10.131 merge regions df93601fdb263771edb48a14ae0c5fa0, 87151af4f2278cc5d26253cec51cd569 2023-07-12 16:15:44,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[df93601fdb263771edb48a14ae0c5fa0, 87151af4f2278cc5d26253cec51cd569], force=true 2023-07-12 16:15:44,352 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[df93601fdb263771edb48a14ae0c5fa0, 87151af4f2278cc5d26253cec51cd569], force=true 2023-07-12 16:15:44,352 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[df93601fdb263771edb48a14ae0c5fa0, 87151af4f2278cc5d26253cec51cd569], force=true 2023-07-12 16:15:44,352 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[df93601fdb263771edb48a14ae0c5fa0, 87151af4f2278cc5d26253cec51cd569], force=true 2023-07-12 16:15:44,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 16:15:44,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df93601fdb263771edb48a14ae0c5fa0, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87151af4f2278cc5d26253cec51cd569, UNASSIGN}] 2023-07-12 16:15:44,386 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df93601fdb263771edb48a14ae0c5fa0, UNASSIGN 2023-07-12 16:15:44,387 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87151af4f2278cc5d26253cec51cd569, UNASSIGN 2023-07-12 16:15:44,388 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=87151af4f2278cc5d26253cec51cd569, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:44,388 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=df93601fdb263771edb48a14ae0c5fa0, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:44,388 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178544387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178544387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178544387"}]},"ts":"1689178544387"} 2023-07-12 16:15:44,388 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178544387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178544387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178544387"}]},"ts":"1689178544387"} 2023-07-12 16:15:44,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 87151af4f2278cc5d26253cec51cd569, server=jenkins-hbase5.apache.org,41787,1689178459474}] 2023-07-12 16:15:44,396 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure df93601fdb263771edb48a14ae0c5fa0, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:15:44,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 16:15:44,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 87151af4f2278cc5d26253cec51cd569 2023-07-12 16:15:44,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 87151af4f2278cc5d26253cec51cd569, disabling compactions & flushes 2023-07-12 16:15:44,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. 2023-07-12 16:15:44,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. 2023-07-12 16:15:44,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. after waiting 0 ms 2023-07-12 16:15:44,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. 2023-07-12 16:15:44,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:15:44,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 87151af4f2278cc5d26253cec51cd569 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 16:15:44,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing df93601fdb263771edb48a14ae0c5fa0, disabling compactions & flushes 2023-07-12 16:15:44,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. 2023-07-12 16:15:44,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. 2023-07-12 16:15:44,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. after waiting 0 ms 2023-07-12 16:15:44,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. 2023-07-12 16:15:44,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing df93601fdb263771edb48a14ae0c5fa0 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 16:15:44,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/.tmp/cf/856e46481d484b19abc3ba8351bf3e84 2023-07-12 16:15:44,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/.tmp/cf/856e46481d484b19abc3ba8351bf3e84 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/cf/856e46481d484b19abc3ba8351bf3e84 2023-07-12 16:15:44,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/.tmp/cf/1657b8dfaebc49c98dfb184a2ff1779c 2023-07-12 16:15:44,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/cf/856e46481d484b19abc3ba8351bf3e84, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 16:15:44,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for df93601fdb263771edb48a14ae0c5fa0 in 55ms, sequenceid=5, compaction requested=false 2023-07-12 16:15:44,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 16:15:44,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/.tmp/cf/1657b8dfaebc49c98dfb184a2ff1779c as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/cf/1657b8dfaebc49c98dfb184a2ff1779c 2023-07-12 16:15:44,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 16:15:44,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:15:44,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0. 2023-07-12 16:15:44,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for df93601fdb263771edb48a14ae0c5fa0: 2023-07-12 16:15:44,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:15:44,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/cf/1657b8dfaebc49c98dfb184a2ff1779c, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 16:15:44,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 87151af4f2278cc5d26253cec51cd569 in 77ms, sequenceid=5, compaction requested=false 2023-07-12 16:15:44,628 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=df93601fdb263771edb48a14ae0c5fa0, regionState=CLOSED 2023-07-12 16:15:44,628 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178544628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178544628"}]},"ts":"1689178544628"} 2023-07-12 16:15:44,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-12 16:15:44,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure df93601fdb263771edb48a14ae0c5fa0, server=jenkins-hbase5.apache.org,44777,1689178459404 in 236 msec 2023-07-12 16:15:44,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df93601fdb263771edb48a14ae0c5fa0, UNASSIGN in 255 msec 2023-07-12 16:15:44,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 16:15:44,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:15:44,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569. 2023-07-12 16:15:44,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 87151af4f2278cc5d26253cec51cd569: 2023-07-12 16:15:44,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 87151af4f2278cc5d26253cec51cd569 2023-07-12 16:15:44,649 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=87151af4f2278cc5d26253cec51cd569, regionState=CLOSED 2023-07-12 16:15:44,649 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689178544649"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178544649"}]},"ts":"1689178544649"} 2023-07-12 16:15:44,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-12 16:15:44,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 87151af4f2278cc5d26253cec51cd569, server=jenkins-hbase5.apache.org,41787,1689178459474 in 263 msec 2023-07-12 16:15:44,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-12 16:15:44,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=87151af4f2278cc5d26253cec51cd569, UNASSIGN in 269 msec 2023-07-12 16:15:44,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 16:15:44,773 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-12 16:15:44,795 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543700.df93601fdb263771edb48a14ae0c5fa0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:44,797 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689178543700.87151af4f2278cc5d26253cec51cd569.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:44,797 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 16:15:44,802 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0004_000001 (auth:SIMPLE) 2023-07-12 16:15:44,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=64474d435b979ff3f15620a20d782132, ASSIGN}] 2023-07-12 16:15:44,894 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=64474d435b979ff3f15620a20d782132, ASSIGN 2023-07-12 16:15:44,895 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=64474d435b979ff3f15620a20d782132, ASSIGN; state=MERGED, location=jenkins-hbase5.apache.org,44777,1689178459404; forceNewPlan=false, retain=false 2023-07-12 16:15:44,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 16:15:45,045 INFO [jenkins-hbase5:43373] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 16:15:45,047 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=64474d435b979ff3f15620a20d782132, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,047 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689178545047"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178545047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178545047"}]},"ts":"1689178545047"} 2023-07-12 16:15:45,049 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 64474d435b979ff3f15620a20d782132, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:15:45,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132. 2023-07-12 16:15:45,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 64474d435b979ff3f15620a20d782132, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132.', STARTKEY => '', ENDKEY => ''} 2023-07-12 16:15:45,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132. service=AccessControlService 2023-07-12 16:15:45,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:15:45,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 64474d435b979ff3f15620a20d782132 2023-07-12 16:15:45,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:15:45,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 64474d435b979ff3f15620a20d782132 2023-07-12 16:15:45,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 64474d435b979ff3f15620a20d782132 2023-07-12 16:15:45,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/.regioninfo 2023-07-12 16:15:45,219 INFO [StoreOpener-64474d435b979ff3f15620a20d782132-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 64474d435b979ff3f15620a20d782132 2023-07-12 16:15:45,220 DEBUG [StoreOpener-64474d435b979ff3f15620a20d782132-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/cf 2023-07-12 16:15:45,220 DEBUG [StoreOpener-64474d435b979ff3f15620a20d782132-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/cf 2023-07-12 16:15:45,221 INFO [StoreOpener-64474d435b979ff3f15620a20d782132-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 64474d435b979ff3f15620a20d782132 columnFamilyName cf 2023-07-12 16:15:45,254 DEBUG [StoreOpener-64474d435b979ff3f15620a20d782132-1] regionserver.HStore(539): loaded hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/cf/1657b8dfaebc49c98dfb184a2ff1779c.87151af4f2278cc5d26253cec51cd569->hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/cf/1657b8dfaebc49c98dfb184a2ff1779c-top 2023-07-12 16:15:45,259 DEBUG [StoreOpener-64474d435b979ff3f15620a20d782132-1] regionserver.HStore(539): loaded hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/cf/856e46481d484b19abc3ba8351bf3e84.df93601fdb263771edb48a14ae0c5fa0->hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/cf/856e46481d484b19abc3ba8351bf3e84-top 2023-07-12 16:15:45,260 INFO [StoreOpener-64474d435b979ff3f15620a20d782132-1] regionserver.HStore(310): Store=64474d435b979ff3f15620a20d782132/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:15:45,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132 2023-07-12 16:15:45,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132 2023-07-12 16:15:45,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 64474d435b979ff3f15620a20d782132 2023-07-12 16:15:45,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 64474d435b979ff3f15620a20d782132; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73234543, jitterRate=0.09127973020076752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:15:45,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 64474d435b979ff3f15620a20d782132: 2023-07-12 16:15:45,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132., pid=77, masterSystemTime=1689178545201 2023-07-12 16:15:45,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132.,because compaction is disabled. 2023-07-12 16:15:45,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132. 2023-07-12 16:15:45,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132. 2023-07-12 16:15:45,279 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=64474d435b979ff3f15620a20d782132, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,280 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689178545279"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178545279"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178545279"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178545279"}]},"ts":"1689178545279"} 2023-07-12 16:15:45,284 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-12 16:15:45,284 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 64474d435b979ff3f15620a20d782132, server=jenkins-hbase5.apache.org,44777,1689178459404 in 232 msec 2023-07-12 16:15:45,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-12 16:15:45,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=64474d435b979ff3f15620a20d782132, ASSIGN in 391 msec 2023-07-12 16:15:45,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[df93601fdb263771edb48a14ae0c5fa0, 87151af4f2278cc5d26253cec51cd569], force=true in 944 msec 2023-07-12 16:15:45,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 16:15:45,464 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-12 16:15:45,465 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 16:15:45,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178545465 (current time:1689178545465). 2023-07-12 16:15:45,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:15:45,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x008f357e to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:45,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54ef2a2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:45,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:45,479 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:60474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:45,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x008f357e to 127.0.0.1:53717 2023-07-12 16:15:45,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:45,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x026656e4 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:15:45,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b3ba713, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:15:45,500 DEBUG [hconnection-0x5628441b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:45,502 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:60480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:45,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:15:45,509 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:54694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:15:45,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x026656e4 to 127.0.0.1:53717 2023-07-12 16:15:45,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:15:45,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 16:15:45,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:15:45,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 16:15:45,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 16:15:45,515 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 16:15:45,515 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689179145515 2023-07-12 16:15:45,515 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 16:15:45,519 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:15:45,519 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:15:45,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 16:15:45,520 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 16:15:45,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-07-12 16:15:45,522 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 16:15:45,522 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689179145522 2023-07-12 16:15:45,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,538 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 16:15:45,538 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:45,539 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-12 16:15:45,539 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-12 16:15:45,614 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,615 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,617 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:45,617 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:45,617 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:45,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:45,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:45,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:45,617 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:45,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:45,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,618 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,618 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:15:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 16:15:45,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,619 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:45,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 16:15:45,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 16:15:45,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,620 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 16:15:45,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,620 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 16:15:45,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,620 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 16:15:45,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 16:15:45,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:45,623 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:15:45,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,626 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 16:15:45,626 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:45,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,626 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 16:15:45,627 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:45,646 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 16:15:45,646 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 16:15:45,646 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 16:15:45,646 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,646 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 16:15:45,647 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 16:15:45,646 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 16:15:45,647 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:15:45,647 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 16:15:45,648 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 16:15:45,655 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 16:15:45,655 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 16:15:45,658 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,659 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,659 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,659 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,659 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:45,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:45,659 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:45,659 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,659 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:45,660 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,660 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:15:45,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:45,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:45,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:45,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:45,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-12 16:15:45,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d7e118a[Count = 0] remaining members to acquire global barrier 2023-07-12 16:15:45,665 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-12 16:15:45,665 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,666 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,666 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,666 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,667 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 16:15:45,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,667 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 16:15:45,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,667 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 16:15:45,667 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 16:15:45,667 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,667 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:15:45,667 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase5.apache.org,41787,1689178459474' in zk 2023-07-12 16:15:45,667 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 16:15:45,667 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase5.apache.org,43171,1689178459521' in zk 2023-07-12 16:15:45,667 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:15:45,667 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:15:45,667 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132. 2023-07-12 16:15:45,668 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132. started... 2023-07-12 16:15:45,669 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 64474d435b979ff3f15620a20d782132: 2023-07-12 16:15:45,670 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,670 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:15:45,670 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/cf/1657b8dfaebc49c98dfb184a2ff1779c.87151af4f2278cc5d26253cec51cd569->hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/cf/1657b8dfaebc49c98dfb184a2ff1779c-top, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/cf/856e46481d484b19abc3ba8351bf3e84.df93601fdb263771edb48a14ae0c5fa0->hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/cf/856e46481d484b19abc3ba8351bf3e84-top] hfiles 2023-07-12 16:15:45,670 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/cf/1657b8dfaebc49c98dfb184a2ff1779c.87151af4f2278cc5d26253cec51cd569 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,671 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/cf/856e46481d484b19abc3ba8351bf3e84.df93601fdb263771edb48a14ae0c5fa0 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,671 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 16:15:45,671 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:45,671 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 16:15:45,681 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 16:15:45,681 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:45,681 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 16:15:45,715 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132. completed. 2023-07-12 16:15:45,715 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132. 2023-07-12 16:15:45,715 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:15:45,715 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:15:45,715 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,715 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 16:15:45,715 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase5.apache.org,44777,1689178459404' in zk 2023-07-12 16:15:45,723 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,723 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 16:15:45,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:45,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:45,723 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:45,723 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 16:15:45,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase5.apache.org,44777,1689178459404': 2023-07-12 16:15:45,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-12 16:15:45,740 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-12 16:15:45,740 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:15:45,740 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:15:45,740 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,740 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:15:45,742 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,743 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,743 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:15:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:15:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,743 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,743 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:45,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,743 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,743 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:45,743 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:15:45,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:45,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,745 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:45,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,745 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:15:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:45,748 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:15:45,748 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,748 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:45,752 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:45,752 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:45,752 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:45,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:45,752 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:45,752 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:45,752 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:45,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:45,753 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:15:45,752 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:15:45,753 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,752 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:45,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:45,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:45,753 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:15:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:15:45,753 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:15:45,753 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,754 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:15:45,754 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:15:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:15:45,754 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:15:45,754 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:15:45,754 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,754 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,824 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:45,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 16:15:45,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:15:45,828 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 16:15:45,847 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-12 16:15:45,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,847 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:45,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689178545516Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689178545753 (+237 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689178545753Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689178545762 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689178545784 (+22 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689178545847 (+63 ms) 2023-07-12 16:15:45,851 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 16:15:45,853 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 332 msec 2023-07-12 16:15:45,861 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:15:46,128 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:15:46,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 16:15:46,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:15:46,130 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178546130 2023-07-12 16:15:46,130 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46851, tgtDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178546130, rawTgtDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178546130, srcFsUri=hdfs://localhost:46851, srcDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:15:46,154 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:15:46,154 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1049888361_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178546130, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178546130/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:46,154 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756, snapshotDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-12 16:15:46,165 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178546130/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:15:46,196 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:46,196 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:46,197 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:46,197 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:47,271 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-6012104995748268346.jar 2023-07-12 16:15:47,271 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:47,272 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:47,360 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-7850464104061380389.jar 2023-07-12 16:15:47,361 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:47,362 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:47,363 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:47,363 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:47,364 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:47,364 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:15:47,365 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:15:47,365 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:15:47,366 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:15:47,367 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:15:47,367 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:15:47,368 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:15:47,368 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:15:47,369 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:15:47,369 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:15:47,370 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:15:47,371 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:47,372 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:47,373 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:47,373 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:47,373 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:15:47,374 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:47,375 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:15:47,530 WARN [DataStreamer for file /user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689178468554_0005/libjars/commons-lang3-3.9.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-12 16:15:49,217 WARN [Listener at jenkins-hbase5.apache.org/37867] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:15:49,224 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-12 16:15:49,228 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-12 16:15:49,372 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:15:49,372 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:15:49,612 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0005_000001 (auth:SIMPLE) 2023-07-12 16:15:50,711 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:15:55,934 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0005_000001 (auth:SIMPLE) 2023-07-12 16:15:58,286 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0005_000001 (auth:SIMPLE) 2023-07-12 16:16:02,385 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0005_000001 (auth:SIMPLE) 2023-07-12 16:16:03,577 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:16:03,581 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:16:03,594 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,594 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:16:03,595 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:16:03,595 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-454504975_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,596 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 16:16:03,596 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 16:16:03,596 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-454504975_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178546130/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178546130/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,597 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178546130/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 16:16:03,597 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178546130/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 16:16:03,605 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,605 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 16:16:03,611 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178563611"}]},"ts":"1689178563611"} 2023-07-12 16:16:03,613 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-12 16:16:03,614 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-12 16:16:03,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=64474d435b979ff3f15620a20d782132, UNASSIGN}] 2023-07-12 16:16:03,618 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=64474d435b979ff3f15620a20d782132, UNASSIGN 2023-07-12 16:16:03,619 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=64474d435b979ff3f15620a20d782132, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:03,619 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689178563619"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178563619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178563619"}]},"ts":"1689178563619"} 2023-07-12 16:16:03,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 64474d435b979ff3f15620a20d782132, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:16:03,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 16:16:03,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 64474d435b979ff3f15620a20d782132 2023-07-12 16:16:03,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 64474d435b979ff3f15620a20d782132, disabling compactions & flushes 2023-07-12 16:16:03,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132. 2023-07-12 16:16:03,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132. 2023-07-12 16:16:03,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132. after waiting 0 ms 2023-07-12 16:16:03,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132. 2023-07-12 16:16:03,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-12 16:16:03,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:03,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132. 2023-07-12 16:16:03,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 64474d435b979ff3f15620a20d782132: 2023-07-12 16:16:03,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 64474d435b979ff3f15620a20d782132 2023-07-12 16:16:03,795 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=64474d435b979ff3f15620a20d782132, regionState=CLOSED 2023-07-12 16:16:03,795 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689178563795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178563795"}]},"ts":"1689178563795"} 2023-07-12 16:16:03,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-12 16:16:03,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 64474d435b979ff3f15620a20d782132, server=jenkins-hbase5.apache.org,44777,1689178459404 in 176 msec 2023-07-12 16:16:03,802 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-12 16:16:03,802 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=64474d435b979ff3f15620a20d782132, UNASSIGN in 185 msec 2023-07-12 16:16:03,803 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178563802"}]},"ts":"1689178563802"} 2023-07-12 16:16:03,805 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-12 16:16:03,807 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-12 16:16:03,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 202 msec 2023-07-12 16:16:03,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 16:16:03,913 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-12 16:16:03,914 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,918 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,919 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,921 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,924 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132 2023-07-12 16:16:03,924 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:16:03,924 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569 2023-07-12 16:16:03,925 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,925 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,925 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,925 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 16:16:03,926 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/recovered.edits] 2023-07-12 16:16:03,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 16:16:03,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 16:16:03,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 16:16:03,926 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/recovered.edits] 2023-07-12 16:16:03,927 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/recovered.edits] 2023-07-12 16:16:03,928 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,928 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:03,928 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,928 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,928 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:03,928 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:03,928 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,928 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:03,929 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:03,929 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:03,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 16:16:03,930 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:03,929 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:03,932 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/cf/1657b8dfaebc49c98dfb184a2ff1779c to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/cf/1657b8dfaebc49c98dfb184a2ff1779c 2023-07-12 16:16:03,933 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/cf/856e46481d484b19abc3ba8351bf3e84 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/cf/856e46481d484b19abc3ba8351bf3e84 2023-07-12 16:16:03,933 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/cf/1657b8dfaebc49c98dfb184a2ff1779c.87151af4f2278cc5d26253cec51cd569 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/cf/1657b8dfaebc49c98dfb184a2ff1779c.87151af4f2278cc5d26253cec51cd569 2023-07-12 16:16:03,940 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/cf/856e46481d484b19abc3ba8351bf3e84.df93601fdb263771edb48a14ae0c5fa0 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/cf/856e46481d484b19abc3ba8351bf3e84.df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:16:03,941 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/recovered.edits/8.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569/recovered.edits/8.seqid 2023-07-12 16:16:03,942 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/87151af4f2278cc5d26253cec51cd569 2023-07-12 16:16:03,942 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/recovered.edits/8.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0/recovered.edits/8.seqid 2023-07-12 16:16:03,943 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df93601fdb263771edb48a14ae0c5fa0 2023-07-12 16:16:03,944 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/recovered.edits/12.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132/recovered.edits/12.seqid 2023-07-12 16:16:03,944 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/64474d435b979ff3f15620a20d782132 2023-07-12 16:16:03,945 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 16:16:03,947 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,949 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-12 16:16:03,952 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-12 16:16:03,953 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,953 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-12 16:16:03,953 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178563953"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:03,954 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-12 16:16:03,955 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 64474d435b979ff3f15620a20d782132, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689178543701.64474d435b979ff3f15620a20d782132.', STARTKEY => '', ENDKEY => ''}] 2023-07-12 16:16:03,955 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-12 16:16:03,955 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178563955"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:03,956 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-12 16:16:03,960 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:03,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 45 msec 2023-07-12 16:16:04,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 16:16:04,031 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-12 16:16:04,032 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,032 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 16:16:04,037 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178564037"}]},"ts":"1689178564037"} 2023-07-12 16:16:04,038 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-12 16:16:04,040 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-12 16:16:04,041 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71c5dfd554a07fec39b10adc358070b6, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=883c226c1b93beabb72803b09c42c449, UNASSIGN}] 2023-07-12 16:16:04,043 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=883c226c1b93beabb72803b09c42c449, UNASSIGN 2023-07-12 16:16:04,044 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71c5dfd554a07fec39b10adc358070b6, UNASSIGN 2023-07-12 16:16:04,044 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=883c226c1b93beabb72803b09c42c449, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:04,044 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=71c5dfd554a07fec39b10adc358070b6, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:04,044 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178564044"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178564044"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178564044"}]},"ts":"1689178564044"} 2023-07-12 16:16:04,044 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178564044"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178564044"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178564044"}]},"ts":"1689178564044"} 2023-07-12 16:16:04,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 883c226c1b93beabb72803b09c42c449, server=jenkins-hbase5.apache.org,43171,1689178459521}] 2023-07-12 16:16:04,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 71c5dfd554a07fec39b10adc358070b6, server=jenkins-hbase5.apache.org,41787,1689178459474}] 2023-07-12 16:16:04,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 16:16:04,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 883c226c1b93beabb72803b09c42c449 2023-07-12 16:16:04,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 883c226c1b93beabb72803b09c42c449, disabling compactions & flushes 2023-07-12 16:16:04,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:16:04,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:16:04,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. after waiting 0 ms 2023-07-12 16:16:04,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:16:04,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 71c5dfd554a07fec39b10adc358070b6 2023-07-12 16:16:04,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 71c5dfd554a07fec39b10adc358070b6, disabling compactions & flushes 2023-07-12 16:16:04,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:16:04,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:16:04,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. after waiting 0 ms 2023-07-12 16:16:04,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:16:04,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:16:04,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:16:04,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:04,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:04,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6. 2023-07-12 16:16:04,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 71c5dfd554a07fec39b10adc358070b6: 2023-07-12 16:16:04,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449. 2023-07-12 16:16:04,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 883c226c1b93beabb72803b09c42c449: 2023-07-12 16:16:04,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 71c5dfd554a07fec39b10adc358070b6 2023-07-12 16:16:04,221 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=71c5dfd554a07fec39b10adc358070b6, regionState=CLOSED 2023-07-12 16:16:04,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 883c226c1b93beabb72803b09c42c449 2023-07-12 16:16:04,221 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178564221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178564221"}]},"ts":"1689178564221"} 2023-07-12 16:16:04,224 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-12 16:16:04,224 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 71c5dfd554a07fec39b10adc358070b6, server=jenkins-hbase5.apache.org,41787,1689178459474 in 175 msec 2023-07-12 16:16:04,224 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=883c226c1b93beabb72803b09c42c449, regionState=CLOSED 2023-07-12 16:16:04,225 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689178564223"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178564223"}]},"ts":"1689178564223"} 2023-07-12 16:16:04,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71c5dfd554a07fec39b10adc358070b6, UNASSIGN in 183 msec 2023-07-12 16:16:04,241 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-12 16:16:04,241 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 883c226c1b93beabb72803b09c42c449, server=jenkins-hbase5.apache.org,43171,1689178459521 in 182 msec 2023-07-12 16:16:04,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-12 16:16:04,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=883c226c1b93beabb72803b09c42c449, UNASSIGN in 200 msec 2023-07-12 16:16:04,244 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178564243"}]},"ts":"1689178564243"} 2023-07-12 16:16:04,245 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-12 16:16:04,248 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-12 16:16:04,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 227 msec 2023-07-12 16:16:04,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 16:16:04,340 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-12 16:16:04,340 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,344 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,345 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,346 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,348 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,348 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,349 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,349 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,349 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 16:16:04,349 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 16:16:04,349 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 16:16:04,349 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 16:16:04,350 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6 2023-07-12 16:16:04,350 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449 2023-07-12 16:16:04,350 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,350 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:04,350 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,350 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:04,351 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,351 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,351 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:04,351 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:04,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 16:16:04,352 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/recovered.edits] 2023-07-12 16:16:04,352 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/recovered.edits] 2023-07-12 16:16:04,357 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/cf/083e3fe9ba33463fa73d481875f96302 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/cf/083e3fe9ba33463fa73d481875f96302 2023-07-12 16:16:04,358 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/cf/ed1afe704ab240dd80f83640a7f30733 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/cf/ed1afe704ab240dd80f83640a7f30733 2023-07-12 16:16:04,370 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/recovered.edits/9.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449/recovered.edits/9.seqid 2023-07-12 16:16:04,370 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/recovered.edits/9.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6/recovered.edits/9.seqid 2023-07-12 16:16:04,372 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/883c226c1b93beabb72803b09c42c449 2023-07-12 16:16:04,378 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71c5dfd554a07fec39b10adc358070b6 2023-07-12 16:16:04,378 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 16:16:04,379 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 16:16:04,380 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-12 16:16:04,384 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307124a64b71839364e82a08ac397f992e783 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307124a64b71839364e82a08ac397f992e783 2023-07-12 16:16:04,385 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712863bc1d3edeb4afc9db7cb9d08c0ba47 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712863bc1d3edeb4afc9db7cb9d08c0ba47 2023-07-12 16:16:04,386 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 16:16:04,388 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,391 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-12 16:16:04,393 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-12 16:16:04,394 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,394 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-12 16:16:04,394 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178564394"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:04,394 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178564394"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:04,397 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 16:16:04,397 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 71c5dfd554a07fec39b10adc358070b6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689178540577.71c5dfd554a07fec39b10adc358070b6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 883c226c1b93beabb72803b09c42c449, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689178540577.883c226c1b93beabb72803b09c42c449.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 16:16:04,397 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-12 16:16:04,397 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178564397"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:04,399 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-12 16:16:04,402 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 62 msec 2023-07-12 16:16:04,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 16:16:04,453 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-12 16:16:04,465 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 16:16:04,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,472 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 16:16:04,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 16:16:04,476 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-12 16:16:04,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 16:16:04,512 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 742) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3992 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x77775a31-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:34298 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase5.apache.org/172.31.10.131:35201 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:46848 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:37438 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2124112068_1 at /127.0.0.1:37416 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2124112068_1 at /127.0.0.1:46810 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 893) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=584 (was 418) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=3632 (was 4117) 2023-07-12 16:16:04,513 WARN [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-12 16:16:04,543 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=584, ProcessCount=171, AvailableMemoryMB=3629 2023-07-12 16:16:04,543 WARN [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-12 16:16:04,545 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 16:16:04,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:04,549 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:16:04,549 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-12 16:16:04,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 16:16:04,551 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:16:04,554 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32 2023-07-12 16:16:04,554 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854 2023-07-12 16:16:04,554 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32 empty. 2023-07-12 16:16:04,554 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854 empty. 2023-07-12 16:16:04,555 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32 2023-07-12 16:16:04,555 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854 2023-07-12 16:16:04,555 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 16:16:04,591 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 16:16:04,593 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4af8058588f64201ccdd113183f60854, NAME => 'testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:16:04,593 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5e59c5e49d9e1a04d2187f81688e6b32, NAME => 'testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:16:04,647 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:04,647 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 4af8058588f64201ccdd113183f60854, disabling compactions & flushes 2023-07-12 16:16:04,647 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:04,647 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:04,647 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 5e59c5e49d9e1a04d2187f81688e6b32, disabling compactions & flushes 2023-07-12 16:16:04,647 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:04,647 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:04,647 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. after waiting 0 ms 2023-07-12 16:16:04,647 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:04,647 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:04,647 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. after waiting 0 ms 2023-07-12 16:16:04,648 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:04,648 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:04,648 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 4af8058588f64201ccdd113183f60854: 2023-07-12 16:16:04,648 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:04,648 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 5e59c5e49d9e1a04d2187f81688e6b32: 2023-07-12 16:16:04,650 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:16:04,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 16:16:04,653 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178564653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178564653"}]},"ts":"1689178564653"} 2023-07-12 16:16:04,654 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178564653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178564653"}]},"ts":"1689178564653"} 2023-07-12 16:16:04,660 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:16:04,661 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:16:04,661 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178564661"}]},"ts":"1689178564661"} 2023-07-12 16:16:04,662 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 16:16:04,665 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:16:04,667 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:16:04,667 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:16:04,667 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:16:04,667 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:16:04,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5e59c5e49d9e1a04d2187f81688e6b32, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4af8058588f64201ccdd113183f60854, ASSIGN}] 2023-07-12 16:16:04,673 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5e59c5e49d9e1a04d2187f81688e6b32, ASSIGN 2023-07-12 16:16:04,673 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4af8058588f64201ccdd113183f60854, ASSIGN 2023-07-12 16:16:04,674 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5e59c5e49d9e1a04d2187f81688e6b32, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41787,1689178459474; forceNewPlan=false, retain=false 2023-07-12 16:16:04,674 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4af8058588f64201ccdd113183f60854, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44777,1689178459404; forceNewPlan=false, retain=false 2023-07-12 16:16:04,824 INFO [jenkins-hbase5:43373] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:16:04,829 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4af8058588f64201ccdd113183f60854, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:04,829 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5e59c5e49d9e1a04d2187f81688e6b32, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:04,829 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178564829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178564829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178564829"}]},"ts":"1689178564829"} 2023-07-12 16:16:04,829 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178564829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178564829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178564829"}]},"ts":"1689178564829"} 2023-07-12 16:16:04,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 4af8058588f64201ccdd113183f60854, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:16:04,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 5e59c5e49d9e1a04d2187f81688e6b32, server=jenkins-hbase5.apache.org,41787,1689178459474}] 2023-07-12 16:16:04,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 16:16:04,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:04,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4af8058588f64201ccdd113183f60854, NAME => 'testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 16:16:04,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. service=AccessControlService 2023-07-12 16:16:04,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:16:04,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4af8058588f64201ccdd113183f60854 2023-07-12 16:16:04,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:04,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 4af8058588f64201ccdd113183f60854 2023-07-12 16:16:04,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 4af8058588f64201ccdd113183f60854 2023-07-12 16:16:04,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:04,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e59c5e49d9e1a04d2187f81688e6b32, NAME => 'testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 16:16:04,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. service=AccessControlService 2023-07-12 16:16:04,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:16:04,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 5e59c5e49d9e1a04d2187f81688e6b32 2023-07-12 16:16:04,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:04,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 5e59c5e49d9e1a04d2187f81688e6b32 2023-07-12 16:16:04,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 5e59c5e49d9e1a04d2187f81688e6b32 2023-07-12 16:16:04,998 INFO [StoreOpener-4af8058588f64201ccdd113183f60854-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4af8058588f64201ccdd113183f60854 2023-07-12 16:16:05,001 DEBUG [StoreOpener-4af8058588f64201ccdd113183f60854-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/cf 2023-07-12 16:16:05,002 DEBUG [StoreOpener-4af8058588f64201ccdd113183f60854-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/cf 2023-07-12 16:16:05,002 INFO [StoreOpener-4af8058588f64201ccdd113183f60854-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4af8058588f64201ccdd113183f60854 columnFamilyName cf 2023-07-12 16:16:05,003 INFO [StoreOpener-5e59c5e49d9e1a04d2187f81688e6b32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5e59c5e49d9e1a04d2187f81688e6b32 2023-07-12 16:16:05,005 INFO [StoreOpener-4af8058588f64201ccdd113183f60854-1] regionserver.HStore(310): Store=4af8058588f64201ccdd113183f60854/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:16:05,006 DEBUG [StoreOpener-5e59c5e49d9e1a04d2187f81688e6b32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/cf 2023-07-12 16:16:05,006 DEBUG [StoreOpener-5e59c5e49d9e1a04d2187f81688e6b32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/cf 2023-07-12 16:16:05,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854 2023-07-12 16:16:05,007 INFO [StoreOpener-5e59c5e49d9e1a04d2187f81688e6b32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e59c5e49d9e1a04d2187f81688e6b32 columnFamilyName cf 2023-07-12 16:16:05,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854 2023-07-12 16:16:05,008 INFO [StoreOpener-5e59c5e49d9e1a04d2187f81688e6b32-1] regionserver.HStore(310): Store=5e59c5e49d9e1a04d2187f81688e6b32/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:16:05,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32 2023-07-12 16:16:05,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32 2023-07-12 16:16:05,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 4af8058588f64201ccdd113183f60854 2023-07-12 16:16:05,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 5e59c5e49d9e1a04d2187f81688e6b32 2023-07-12 16:16:05,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:16:05,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:16:05,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 4af8058588f64201ccdd113183f60854; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67963698, jitterRate=0.012738019227981567}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:16:05,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 4af8058588f64201ccdd113183f60854: 2023-07-12 16:16:05,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 5e59c5e49d9e1a04d2187f81688e6b32; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67265095, jitterRate=0.002328023314476013}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:16:05,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 5e59c5e49d9e1a04d2187f81688e6b32: 2023-07-12 16:16:05,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854., pid=93, masterSystemTime=1689178564984 2023-07-12 16:16:05,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32., pid=94, masterSystemTime=1689178564985 2023-07-12 16:16:05,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:05,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:05,028 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4af8058588f64201ccdd113183f60854, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,028 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178565028"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178565028"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178565028"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178565028"}]},"ts":"1689178565028"} 2023-07-12 16:16:05,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:05,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:05,029 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5e59c5e49d9e1a04d2187f81688e6b32, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,029 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178565029"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178565029"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178565029"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178565029"}]},"ts":"1689178565029"} 2023-07-12 16:16:05,033 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-12 16:16:05,033 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 4af8058588f64201ccdd113183f60854, server=jenkins-hbase5.apache.org,44777,1689178459404 in 199 msec 2023-07-12 16:16:05,034 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-12 16:16:05,034 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 5e59c5e49d9e1a04d2187f81688e6b32, server=jenkins-hbase5.apache.org,41787,1689178459474 in 199 msec 2023-07-12 16:16:05,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4af8058588f64201ccdd113183f60854, ASSIGN in 366 msec 2023-07-12 16:16:05,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-12 16:16:05,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5e59c5e49d9e1a04d2187f81688e6b32, ASSIGN in 367 msec 2023-07-12 16:16:05,038 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:16:05,038 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178565038"}]},"ts":"1689178565038"} 2023-07-12 16:16:05,039 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 16:16:05,043 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:16:05,044 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-12 16:16:05,045 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 16:16:05,047 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:05,047 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:05,047 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:05,047 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:05,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:05,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:05,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:05,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:05,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 507 msec 2023-07-12 16:16:05,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 16:16:05,160 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-12 16:16:05,163 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 16:16:05,163 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:05,165 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:16:05,180 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:16:05,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178565180 (current time:1689178565180). 2023-07-12 16:16:05,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:16:05,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x1c9df879 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:05,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@453f1b83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:05,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:05,201 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:49722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:05,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c9df879 to 127.0.0.1:53717 2023-07-12 16:16:05,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:05,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x20e343a3 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:05,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53ce39f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:05,211 DEBUG [hconnection-0x6e10c30f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:05,214 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:49730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:05,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:05,220 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:05,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20e343a3 to 127.0.0.1:53717 2023-07-12 16:16:05,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:05,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 16:16:05,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:16:05,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:16:05,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:16:05,226 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:16:05,227 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689179165227 2023-07-12 16:16:05,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:16:05,227 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 16:16:05,231 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:16:05,231 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:16:05,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 16:16:05,232 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:16:05,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-12 16:16:05,236 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 16:16:05,237 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689179165237 2023-07-12 16:16:05,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,250 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-12 16:16:05,251 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:05,252 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 16:16:05,252 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 16:16:05,253 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,253 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,258 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,258 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,258 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,258 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,258 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,258 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,259 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,259 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:16:05,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 16:16:05,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 16:16:05,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 16:16:05,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,260 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 16:16:05,260 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 16:16:05,260 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 16:16:05,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,260 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 16:16:05,260 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:05,260 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 16:16:05,260 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:05,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,260 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 16:16:05,262 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 16:16:05,262 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:05,262 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 16:16:05,262 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 16:16:05,262 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 16:16:05,263 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 16:16:05,263 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 16:16:05,264 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,264 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,264 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:05,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:05,265 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,265 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:05,265 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,265 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:05,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:05,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:05,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:05,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 16:16:05,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45105dbf[Count = 1] remaining members to acquire global barrier 2023-07-12 16:16:05,268 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 16:16:05,268 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 16:16:05,268 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 16:16:05,270 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,270 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:05,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:05,270 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,270 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:05,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:05,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 16:16:05,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45105dbf[Count = 0] remaining members to acquire global barrier 2023-07-12 16:16:05,272 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 16:16:05,272 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,273 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,273 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,274 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,273 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,274 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:16:05,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,274 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 16:16:05,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,274 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,274 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:16:05,274 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,43171,1689178459521' in zk 2023-07-12 16:16:05,274 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:16:05,274 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:16:05,274 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:05,274 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:05,274 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:05,274 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:05,274 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:05,274 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:05,275 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. started... 2023-07-12 16:16:05,275 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. started... 2023-07-12 16:16:05,276 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4af8058588f64201ccdd113183f60854: 2023-07-12 16:16:05,276 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5e59c5e49d9e1a04d2187f81688e6b32: 2023-07-12 16:16:05,276 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 16:16:05,276 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:05,276 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,276 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,276 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 16:16:05,277 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:05,276 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:05,278 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:16:05,278 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:16:05,298 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. completed. 2023-07-12 16:16:05,298 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:05,298 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:05,298 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:05,299 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,299 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 16:16:05,299 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,44777,1689178459404' in zk 2023-07-12 16:16:05,299 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. completed. 2023-07-12 16:16:05,299 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:05,299 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:05,299 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:05,299 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,299 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 16:16:05,299 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,41787,1689178459474' in zk 2023-07-12 16:16:05,303 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 16:16:05,303 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,303 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:05,303 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 16:16:05,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:05,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:05,305 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 16:16:05,305 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,305 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:05,305 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 16:16:05,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:05,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:05,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase5.apache.org,44777,1689178459404': 2023-07-12 16:16:05,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 16:16:05,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:05,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:05,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:05,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:05,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:05,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase5.apache.org,41787,1689178459474': 2023-07-12 16:16:05,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 16:16:05,315 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 16:16:05,315 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:16:05,315 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:16:05,315 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,315 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:16:05,317 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,317 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,317 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:05,317 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,317 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,317 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,317 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:05,318 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,319 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:05,319 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:05,321 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,322 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,322 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,325 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,325 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,325 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,325 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,325 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,325 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:05,325 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,326 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,326 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,325 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,325 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,327 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 16:16:05,327 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,328 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 16:16:05,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,328 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,328 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,328 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,328 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,328 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,328 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 16:16:05,331 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:05,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:16:05,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:16:05,333 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:16:05,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,414 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 16:16:05,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,414 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689178565227Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689178565337 (+110 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689178565337Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689178565337Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689178565342 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689178565369 (+27 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689178565414 (+45 ms) 2023-07-12 16:16:05,418 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 16:16:05,420 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 189 msec 2023-07-12 16:16:05,533 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:05,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:16:05,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:16:05,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41787] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:16:05,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44777] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:16:05,541 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 16:16:05,541 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:05,542 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:16:05,553 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:16:05,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178565554 (current time:1689178565554). 2023-07-12 16:16:05,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:16:05,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x6d05dc05 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:05,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5656211, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:05,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:05,567 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:49734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:05,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d05dc05 to 127.0.0.1:53717 2023-07-12 16:16:05,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:05,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x1ae4fb88 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:05,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5942f925, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:05,578 DEBUG [hconnection-0x77197df6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:05,579 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:49736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:05,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:05,586 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:45966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:05,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ae4fb88 to 127.0.0.1:53717 2023-07-12 16:16:05,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:05,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 16:16:05,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:16:05,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:16:05,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:16:05,591 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:16:05,591 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689179165591 2023-07-12 16:16:05,591 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 16:16:05,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 16:16:05,593 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:16:05,593 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:16:05,594 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 16:16:05,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 16:16:05,595 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-12 16:16:05,595 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 16:16:05,596 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689179165596 2023-07-12 16:16:05,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,607 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-12 16:16:05,607 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:05,609 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 16:16:05,609 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 16:16:05,609 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,609 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,612 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,612 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,612 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,612 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,612 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,612 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,613 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,613 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:16:05,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 16:16:05,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 16:16:05,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 16:16:05,613 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 16:16:05,614 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 16:16:05,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,614 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 16:16:05,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,614 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 16:16:05,614 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:05,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,615 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 16:16:05,616 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 16:16:05,616 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:05,616 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 16:16:05,617 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 16:16:05,617 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 16:16:05,616 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:05,617 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 16:16:05,617 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 16:16:05,621 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 16:16:05,620 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 16:16:05,621 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 16:16:05,621 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 16:16:05,628 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,628 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:05,628 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,628 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:05,629 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,628 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,629 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:05,629 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,629 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:05,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:05,629 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,629 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:05,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:05,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 16:16:05,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31abaf2f[Count = 1] remaining members to acquire global barrier 2023-07-12 16:16:05,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:05,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:05,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:05,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:05,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:05,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 16:16:05,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31abaf2f[Count = 0] remaining members to acquire global barrier 2023-07-12 16:16:05,634 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 16:16:05,634 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,640 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,640 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,640 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,640 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:16:05,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,640 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,640 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:05,640 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:16:05,640 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 16:16:05,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,641 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,43171,1689178459521' in zk 2023-07-12 16:16:05,640 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:05,640 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:05,641 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. started... 2023-07-12 16:16:05,641 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,641 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:16:05,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,641 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 16:16:05,641 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5e59c5e49d9e1a04d2187f81688e6b32 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-12 16:16:05,642 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:05,642 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:05,642 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:05,642 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. started... 2023-07-12 16:16:05,642 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 16:16:05,642 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4af8058588f64201ccdd113183f60854 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-12 16:16:05,642 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:05,643 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 16:16:05,686 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071282cb24cd5d9c46d29e2200b4c1298741 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071282cb24cd5d9c46d29e2200b4c1298741 2023-07-12 16:16:05,693 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:05,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:16:05,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:16:05,695 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:16:05,699 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/.tmp/cf/84dd735d49824f8e998e427f9bf80c89 2023-07-12 16:16:05,699 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712fdcfd264e2f44ee3a2049aa8eb36d0f9 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712fdcfd264e2f44ee3a2049aa8eb36d0f9 2023-07-12 16:16:05,707 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/.tmp/cf/84dd735d49824f8e998e427f9bf80c89 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/cf/84dd735d49824f8e998e427f9bf80c89 2023-07-12 16:16:05,710 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/.tmp/cf/4ed5345f8ad6402eb540d7c7c9810435 2023-07-12 16:16:05,713 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/cf/84dd735d49824f8e998e427f9bf80c89, entries=2, sequenceid=6, filesize=5.2 K 2023-07-12 16:16:05,714 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 5e59c5e49d9e1a04d2187f81688e6b32 in 73ms, sequenceid=6, compaction requested=false 2023-07-12 16:16:05,715 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-12 16:16:05,715 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5e59c5e49d9e1a04d2187f81688e6b32: 2023-07-12 16:16:05,715 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,717 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:05,717 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/cf/84dd735d49824f8e998e427f9bf80c89] hfiles 2023-07-12 16:16:05,717 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/cf/84dd735d49824f8e998e427f9bf80c89 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,724 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/.tmp/cf/4ed5345f8ad6402eb540d7c7c9810435 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/cf/4ed5345f8ad6402eb540d7c7c9810435 2023-07-12 16:16:05,732 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/cf/4ed5345f8ad6402eb540d7c7c9810435, entries=48, sequenceid=6, filesize=13.2 K 2023-07-12 16:16:05,733 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 4af8058588f64201ccdd113183f60854 in 91ms, sequenceid=6, compaction requested=false 2023-07-12 16:16:05,736 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4af8058588f64201ccdd113183f60854: 2023-07-12 16:16:05,737 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,737 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:05,737 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/cf/4ed5345f8ad6402eb540d7c7c9810435] hfiles 2023-07-12 16:16:05,737 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/cf/4ed5345f8ad6402eb540d7c7c9810435 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,747 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. completed. 2023-07-12 16:16:05,747 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:05,748 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:05,748 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:05,748 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,748 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 16:16:05,748 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,41787,1689178459474' in zk 2023-07-12 16:16:05,750 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 16:16:05,750 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,750 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:05,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:05,750 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 16:16:05,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:05,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:05,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:05,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:05,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase5.apache.org,41787,1689178459474': 2023-07-12 16:16:05,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 16:16:05,761 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. completed. 2023-07-12 16:16:05,761 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:05,761 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:05,761 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:05,761 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,761 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 16:16:05,761 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase5.apache.org,44777,1689178459404' in zk 2023-07-12 16:16:05,763 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,763 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 16:16:05,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:05,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:05,763 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:05,763 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 16:16:05,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:05,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase5.apache.org,44777,1689178459404': 2023-07-12 16:16:05,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 16:16:05,769 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 16:16:05,769 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:16:05,769 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:16:05,769 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,769 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:16:05,772 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,772 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:05,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:05,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,772 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,772 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,772 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,773 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,773 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:05,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,773 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,774 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:05,774 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:05,776 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,778 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,778 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,782 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,782 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,782 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,782 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,782 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,782 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:05,782 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,782 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,782 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,782 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:05,782 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 16:16:05,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,782 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,782 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:05,782 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,782 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,784 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:05,784 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:05,784 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,784 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 16:16:05,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,782 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:05,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:05,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:05,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:05,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:05,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712fdcfd264e2f44ee3a2049aa8eb36d0f9, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071282cb24cd5d9c46d29e2200b4c1298741] mob files 2023-07-12 16:16:05,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712fdcfd264e2f44ee3a2049aa8eb36d0f9 2023-07-12 16:16:05,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071282cb24cd5d9c46d29e2200b4c1298741 2023-07-12 16:16:05,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,875 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 16:16:05,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,876 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689178565591Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689178565809 (+218 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689178565809Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689178565809Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689178565816 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689178565841 (+25 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689178565875 (+34 ms) 2023-07-12 16:16:05,882 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 16:16:05,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 290 msec 2023-07-12 16:16:05,895 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:05,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 16:16:05,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:16:05,896 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178565896 2023-07-12 16:16:05,896 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46851, tgtDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178565896, rawTgtDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178565896, srcFsUri=hdfs://localhost:46851, srcDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:16:05,925 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:16:05,926 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-857421245_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178565896, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178565896/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,926 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756, snapshotDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-12 16:16:05,932 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178565896/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:05,990 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:05,990 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:05,991 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:05,991 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,145 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-8624757894629644032.jar 2023-07-12 16:16:07,145 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,146 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,236 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-2274882890967745971.jar 2023-07-12 16:16:07,236 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,237 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,237 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,238 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,238 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,238 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:07,239 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:16:07,239 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:16:07,239 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:16:07,240 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:16:07,240 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:16:07,241 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:16:07,241 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:16:07,241 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:16:07,242 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:16:07,242 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:16:07,243 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:07,243 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:07,244 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:16:07,244 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:07,245 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:07,245 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:16:07,246 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:16:08,514 WARN [Listener at jenkins-hbase5.apache.org/37867] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:16:08,529 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-12 16:16:08,547 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0005_000001 (auth:SIMPLE) 2023-07-12 16:16:08,781 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:16:08,781 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:16:08,853 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0006_000001 (auth:SIMPLE) 2023-07-12 16:16:09,465 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:16:16,042 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0006_000001 (auth:SIMPLE) 2023-07-12 16:16:18,984 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:16:18,986 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:16:19,002 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:19,002 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:16:19,003 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:16:19,003 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-454504975_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:19,004 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 16:16:19,004 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 16:16:19,004 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-454504975_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178565896/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178565896/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:19,004 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178565896/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 16:16:19,004 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178565896/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 16:16:19,020 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,021 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 16:16:19,026 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178579026"}]},"ts":"1689178579026"} 2023-07-12 16:16:19,028 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 16:16:19,030 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-12 16:16:19,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5e59c5e49d9e1a04d2187f81688e6b32, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4af8058588f64201ccdd113183f60854, UNASSIGN}] 2023-07-12 16:16:19,032 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4af8058588f64201ccdd113183f60854, UNASSIGN 2023-07-12 16:16:19,034 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4af8058588f64201ccdd113183f60854, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:19,034 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178579034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178579034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178579034"}]},"ts":"1689178579034"} 2023-07-12 16:16:19,036 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5e59c5e49d9e1a04d2187f81688e6b32, UNASSIGN 2023-07-12 16:16:19,037 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5e59c5e49d9e1a04d2187f81688e6b32, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:19,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 4af8058588f64201ccdd113183f60854, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:16:19,038 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178579037"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178579037"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178579037"}]},"ts":"1689178579037"} 2023-07-12 16:16:19,039 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 5e59c5e49d9e1a04d2187f81688e6b32, server=jenkins-hbase5.apache.org,41787,1689178459474}] 2023-07-12 16:16:19,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 16:16:19,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 4af8058588f64201ccdd113183f60854 2023-07-12 16:16:19,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 4af8058588f64201ccdd113183f60854, disabling compactions & flushes 2023-07-12 16:16:19,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:19,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:19,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. after waiting 0 ms 2023-07-12 16:16:19,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:19,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 5e59c5e49d9e1a04d2187f81688e6b32 2023-07-12 16:16:19,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 5e59c5e49d9e1a04d2187f81688e6b32, disabling compactions & flushes 2023-07-12 16:16:19,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:19,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:19,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. after waiting 0 ms 2023-07-12 16:16:19,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:19,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:16:19,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:19,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854. 2023-07-12 16:16:19,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:16:19,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 4af8058588f64201ccdd113183f60854: 2023-07-12 16:16:19,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:19,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32. 2023-07-12 16:16:19,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 5e59c5e49d9e1a04d2187f81688e6b32: 2023-07-12 16:16:19,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 4af8058588f64201ccdd113183f60854 2023-07-12 16:16:19,221 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4af8058588f64201ccdd113183f60854, regionState=CLOSED 2023-07-12 16:16:19,221 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178579221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178579221"}]},"ts":"1689178579221"} 2023-07-12 16:16:19,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 5e59c5e49d9e1a04d2187f81688e6b32 2023-07-12 16:16:19,221 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5e59c5e49d9e1a04d2187f81688e6b32, regionState=CLOSED 2023-07-12 16:16:19,221 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689178579221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178579221"}]},"ts":"1689178579221"} 2023-07-12 16:16:19,224 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-12 16:16:19,224 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 4af8058588f64201ccdd113183f60854, server=jenkins-hbase5.apache.org,44777,1689178459404 in 185 msec 2023-07-12 16:16:19,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-12 16:16:19,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 5e59c5e49d9e1a04d2187f81688e6b32, server=jenkins-hbase5.apache.org,41787,1689178459474 in 184 msec 2023-07-12 16:16:19,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4af8058588f64201ccdd113183f60854, UNASSIGN in 194 msec 2023-07-12 16:16:19,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-12 16:16:19,227 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5e59c5e49d9e1a04d2187f81688e6b32, UNASSIGN in 195 msec 2023-07-12 16:16:19,227 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178579227"}]},"ts":"1689178579227"} 2023-07-12 16:16:19,228 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 16:16:19,230 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-12 16:16:19,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 210 msec 2023-07-12 16:16:19,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 16:16:19,328 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-12 16:16:19,329 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,333 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,334 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,338 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,343 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,343 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,343 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,343 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,343 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 16:16:19,343 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 16:16:19,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 16:16:19,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 16:16:19,345 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,345 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,345 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,345 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:19,345 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:19,345 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,345 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:19,345 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:19,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 16:16:19,354 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854 2023-07-12 16:16:19,355 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32 2023-07-12 16:16:19,360 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/recovered.edits] 2023-07-12 16:16:19,361 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/recovered.edits] 2023-07-12 16:16:19,367 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/cf/4ed5345f8ad6402eb540d7c7c9810435 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/cf/4ed5345f8ad6402eb540d7c7c9810435 2023-07-12 16:16:19,367 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/cf/84dd735d49824f8e998e427f9bf80c89 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/cf/84dd735d49824f8e998e427f9bf80c89 2023-07-12 16:16:19,373 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/recovered.edits/9.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32/recovered.edits/9.seqid 2023-07-12 16:16:19,373 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/recovered.edits/9.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854/recovered.edits/9.seqid 2023-07-12 16:16:19,373 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/5e59c5e49d9e1a04d2187f81688e6b32 2023-07-12 16:16:19,374 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testEmptyExportFileSystemState/4af8058588f64201ccdd113183f60854 2023-07-12 16:16:19,374 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 16:16:19,375 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 16:16:19,375 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-12 16:16:19,381 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712fdcfd264e2f44ee3a2049aa8eb36d0f9 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712fdcfd264e2f44ee3a2049aa8eb36d0f9 2023-07-12 16:16:19,383 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071282cb24cd5d9c46d29e2200b4c1298741 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071282cb24cd5d9c46d29e2200b4c1298741 2023-07-12 16:16:19,383 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 16:16:19,386 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,388 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-12 16:16:19,391 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-12 16:16:19,393 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,393 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-12 16:16:19,393 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178579393"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:19,393 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178579393"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:19,401 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 16:16:19,401 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5e59c5e49d9e1a04d2187f81688e6b32, NAME => 'testtb-testEmptyExportFileSystemState,,1689178564545.5e59c5e49d9e1a04d2187f81688e6b32.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4af8058588f64201ccdd113183f60854, NAME => 'testtb-testEmptyExportFileSystemState,1,1689178564545.4af8058588f64201ccdd113183f60854.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 16:16:19,401 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-12 16:16:19,401 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178579401"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:19,408 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-12 16:16:19,411 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 16:16:19,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 82 msec 2023-07-12 16:16:19,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 16:16:19,452 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-12 16:16:19,464 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-12 16:16:19,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:19,474 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-12 16:16:19,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43373] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-12 16:16:19,536 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 758) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4680 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase5.apache.org/172.31.10.131:44345 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase5.apache.org/172.31.10.131:37867 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:40358 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:38606 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2078387055_1 at /127.0.0.1:40334 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:35252 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2078387055_1 at /127.0.0.1:35218 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=907 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=616 (was 584) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=3597 (was 3629) 2023-07-12 16:16:19,536 WARN [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-12 16:16:19,572 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=616, ProcessCount=171, AvailableMemoryMB=3598 2023-07-12 16:16:19,572 WARN [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-12 16:16:19,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.HMaster$4(2112): Client=jenkins//172.31.10.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 16:16:19,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:19,580 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 16:16:19,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(700): Client=jenkins//172.31.10.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-12 16:16:19,581 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 16:16:19,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 16:16:19,587 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e 2023-07-12 16:16:19,587 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8 2023-07-12 16:16:19,588 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8 empty. 2023-07-12 16:16:19,589 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e empty. 2023-07-12 16:16:19,589 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8 2023-07-12 16:16:19,589 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e 2023-07-12 16:16:19,589 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 16:16:19,654 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-12 16:16:19,672 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => be79aec1922b3a1a513039a766391da8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:16:19,683 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 335ae7356576466ade560c8582a48e7e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp 2023-07-12 16:16:19,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 16:16:19,782 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:19,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing be79aec1922b3a1a513039a766391da8, disabling compactions & flushes 2023-07-12 16:16:19,783 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:19,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:19,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. after waiting 0 ms 2023-07-12 16:16:19,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:19,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:19,783 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:19,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for be79aec1922b3a1a513039a766391da8: 2023-07-12 16:16:19,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 335ae7356576466ade560c8582a48e7e, disabling compactions & flushes 2023-07-12 16:16:19,783 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:19,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:19,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. after waiting 0 ms 2023-07-12 16:16:19,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:19,783 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:19,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 335ae7356576466ade560c8582a48e7e: 2023-07-12 16:16:19,786 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 16:16:19,788 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178579787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178579787"}]},"ts":"1689178579787"} 2023-07-12 16:16:19,788 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178579787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178579787"}]},"ts":"1689178579787"} 2023-07-12 16:16:19,791 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 16:16:19,792 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 16:16:19,792 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178579792"}]},"ts":"1689178579792"} 2023-07-12 16:16:19,800 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-12 16:16:19,803 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase5.apache.org=0} racks are {/default-rack=0} 2023-07-12 16:16:19,804 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 16:16:19,804 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 16:16:19,804 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 16:16:19,804 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 16:16:19,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be79aec1922b3a1a513039a766391da8, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335ae7356576466ade560c8582a48e7e, ASSIGN}] 2023-07-12 16:16:19,807 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be79aec1922b3a1a513039a766391da8, ASSIGN 2023-07-12 16:16:19,807 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335ae7356576466ade560c8582a48e7e, ASSIGN 2023-07-12 16:16:19,808 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be79aec1922b3a1a513039a766391da8, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,44777,1689178459404; forceNewPlan=false, retain=false 2023-07-12 16:16:19,808 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335ae7356576466ade560c8582a48e7e, ASSIGN; state=OFFLINE, location=jenkins-hbase5.apache.org,41787,1689178459474; forceNewPlan=false, retain=false 2023-07-12 16:16:19,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 16:16:19,958 INFO [jenkins-hbase5:43373] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 16:16:19,962 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=be79aec1922b3a1a513039a766391da8, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:19,962 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178579962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178579962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178579962"}]},"ts":"1689178579962"} 2023-07-12 16:16:19,963 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=335ae7356576466ade560c8582a48e7e, regionState=OPENING, regionLocation=jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:19,963 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178579963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178579963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178579963"}]},"ts":"1689178579963"} 2023-07-12 16:16:19,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure be79aec1922b3a1a513039a766391da8, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:16:19,966 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 335ae7356576466ade560c8582a48e7e, server=jenkins-hbase5.apache.org,41787,1689178459474}] 2023-07-12 16:16:20,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:20,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be79aec1922b3a1a513039a766391da8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 16:16:20,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. service=AccessControlService 2023-07-12 16:16:20,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 335ae7356576466ade560c8582a48e7e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 16:16:20,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:16:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. service=AccessControlService 2023-07-12 16:16:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp be79aec1922b3a1a513039a766391da8 2023-07-12 16:16:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:20,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 16:16:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for be79aec1922b3a1a513039a766391da8 2023-07-12 16:16:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for be79aec1922b3a1a513039a766391da8 2023-07-12 16:16:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 335ae7356576466ade560c8582a48e7e 2023-07-12 16:16:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 16:16:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7894): checking encryption for 335ae7356576466ade560c8582a48e7e 2023-07-12 16:16:20,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(7897): checking classloading for 335ae7356576466ade560c8582a48e7e 2023-07-12 16:16:20,124 INFO [StoreOpener-be79aec1922b3a1a513039a766391da8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region be79aec1922b3a1a513039a766391da8 2023-07-12 16:16:20,124 INFO [StoreOpener-335ae7356576466ade560c8582a48e7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 335ae7356576466ade560c8582a48e7e 2023-07-12 16:16:20,125 DEBUG [StoreOpener-be79aec1922b3a1a513039a766391da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/cf 2023-07-12 16:16:20,126 DEBUG [StoreOpener-be79aec1922b3a1a513039a766391da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/cf 2023-07-12 16:16:20,126 DEBUG [StoreOpener-335ae7356576466ade560c8582a48e7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/cf 2023-07-12 16:16:20,126 DEBUG [StoreOpener-335ae7356576466ade560c8582a48e7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/cf 2023-07-12 16:16:20,126 INFO [StoreOpener-be79aec1922b3a1a513039a766391da8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be79aec1922b3a1a513039a766391da8 columnFamilyName cf 2023-07-12 16:16:20,126 INFO [StoreOpener-335ae7356576466ade560c8582a48e7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 335ae7356576466ade560c8582a48e7e columnFamilyName cf 2023-07-12 16:16:20,128 INFO [StoreOpener-335ae7356576466ade560c8582a48e7e-1] regionserver.HStore(310): Store=335ae7356576466ade560c8582a48e7e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:16:20,128 INFO [StoreOpener-be79aec1922b3a1a513039a766391da8-1] regionserver.HStore(310): Store=be79aec1922b3a1a513039a766391da8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 16:16:20,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e 2023-07-12 16:16:20,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8 2023-07-12 16:16:20,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8 2023-07-12 16:16:20,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e 2023-07-12 16:16:20,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for 335ae7356576466ade560c8582a48e7e 2023-07-12 16:16:20,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1055): writing seq id for be79aec1922b3a1a513039a766391da8 2023-07-12 16:16:20,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:16:20,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened 335ae7356576466ade560c8582a48e7e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75462689, jitterRate=0.1244816929101944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:16:20,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for 335ae7356576466ade560c8582a48e7e: 2023-07-12 16:16:20,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e., pid=109, masterSystemTime=1689178580118 2023-07-12 16:16:20,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 16:16:20,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1072): Opened be79aec1922b3a1a513039a766391da8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73178442, jitterRate=0.09044376015663147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 16:16:20,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(965): Region open journal for be79aec1922b3a1a513039a766391da8: 2023-07-12 16:16:20,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:20,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:20,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8., pid=108, masterSystemTime=1689178580117 2023-07-12 16:16:20,145 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=335ae7356576466ade560c8582a48e7e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,145 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178580145"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178580145"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178580145"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178580145"}]},"ts":"1689178580145"} 2023-07-12 16:16:20,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:20,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase5:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:20,148 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=be79aec1922b3a1a513039a766391da8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,148 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178580148"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689178580148"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689178580148"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689178580148"}]},"ts":"1689178580148"} 2023-07-12 16:16:20,150 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-12 16:16:20,150 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 335ae7356576466ade560c8582a48e7e, server=jenkins-hbase5.apache.org,41787,1689178459474 in 181 msec 2023-07-12 16:16:20,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335ae7356576466ade560c8582a48e7e, ASSIGN in 345 msec 2023-07-12 16:16:20,153 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-12 16:16:20,153 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure be79aec1922b3a1a513039a766391da8, server=jenkins-hbase5.apache.org,44777,1689178459404 in 185 msec 2023-07-12 16:16:20,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-12 16:16:20,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be79aec1922b3a1a513039a766391da8, ASSIGN in 348 msec 2023-07-12 16:16:20,157 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 16:16:20,157 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178580157"}]},"ts":"1689178580157"} 2023-07-12 16:16:20,159 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-12 16:16:20,161 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 16:16:20,162 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-12 16:16:20,163 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 16:16:20,166 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:20,166 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:20,166 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:20,166 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:20,168 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:20,168 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:20,168 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:20,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 16:16:20,170 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 592 msec 2023-07-12 16:16:20,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 16:16:20,187 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-12 16:16:20,197 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,197 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:20,200 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:16:20,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 16:16:20,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178580219 (current time:1689178580219). 2023-07-12 16:16:20,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:16:20,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x10591e46 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:20,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61433494, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:20,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:20,250 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:20,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10591e46 to 127.0.0.1:53717 2023-07-12 16:16:20,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:20,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x09ab094e to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:20,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51588d13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:20,288 DEBUG [hconnection-0x29c7f438-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:20,294 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:20,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:20,307 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:56116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:20,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09ab094e to 127.0.0.1:53717 2023-07-12 16:16:20,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:20,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 16:16:20,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:16:20,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 16:16:20,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 16:16:20,318 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 16:16:20,321 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689179180321 2023-07-12 16:16:20,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 16:16:20,321 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,321 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:16:20,321 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:16:20,331 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 16:16:20,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 16:16:20,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 16 msec 2023-07-12 16:16:20,339 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 16:16:20,340 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689179180340 2023-07-12 16:16:20,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,385 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 16:16:20,385 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,387 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 16:16:20,387 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 16:16:20,416 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,416 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,417 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,417 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,417 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,417 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,418 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,418 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,418 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,418 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:16:20,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 16:16:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 16:16:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 16:16:20,420 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 16:16:20,420 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 16:16:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,420 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,420 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 16:16:20,420 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 16:16:20,420 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,421 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:20,423 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 16:16:20,423 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 16:16:20,423 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,423 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 16:16:20,423 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,423 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 16:16:20,424 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,424 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 16:16:20,424 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,425 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 16:16:20,425 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 16:16:20,425 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 16:16:20,426 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 16:16:20,426 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 16:16:20,426 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 16:16:20,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 16:16:20,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:16:20,426 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:16:20,430 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,430 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,430 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,432 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,432 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,432 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:20,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,434 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,435 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,435 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:20,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,435 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,435 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:20,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 16:16:20,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4587894c[Count = 1] remaining members to acquire global barrier 2023-07-12 16:16:20,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 16:16:20,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4587894c[Count = 0] remaining members to acquire global barrier 2023-07-12 16:16:20,440 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 16:16:20,440 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,448 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,448 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,448 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,448 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 16:16:20,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,449 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 16:16:20,449 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,449 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:20,449 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:20,449 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 16:16:20,449 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 16:16:20,449 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,43171,1689178459521' in zk 2023-07-12 16:16:20,449 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:20,449 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,449 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:16:20,449 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. started... 2023-07-12 16:16:20,451 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 16:16:20,451 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:20,451 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 16:16:20,457 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:20,459 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:20,459 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. started... 2023-07-12 16:16:20,459 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:20,459 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 335ae7356576466ade560c8582a48e7e: 2023-07-12 16:16:20,459 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for be79aec1922b3a1a513039a766391da8: 2023-07-12 16:16:20,459 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,460 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:20,460 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:16:20,460 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,460 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:20,460 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 16:16:20,471 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. completed. 2023-07-12 16:16:20,471 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:20,471 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:20,472 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:20,472 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,472 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 16:16:20,472 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,41787,1689178459474' in zk 2023-07-12 16:16:20,473 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,473 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 16:16:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,474 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:20,474 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 16:16:20,474 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. completed. 2023-07-12 16:16:20,476 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:20,476 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:20,476 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:20,476 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,476 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 16:16:20,476 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,44777,1689178459404' in zk 2023-07-12 16:16:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,478 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,478 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 16:16:20,478 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:20,478 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 16:16:20,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase5.apache.org,41787,1689178459474': 2023-07-12 16:16:20,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 16:16:20,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase5.apache.org,44777,1689178459404': 2023-07-12 16:16:20,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 16:16:20,491 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 16:16:20,491 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:16:20,491 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:16:20,491 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,491 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:16:20,493 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,493 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,493 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,493 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,493 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,493 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,494 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,495 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,496 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,496 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,498 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,499 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,499 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,509 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,509 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,509 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,509 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,509 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,510 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,510 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,510 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,510 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:20,510 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,510 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,509 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:20,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 16:16:20,510 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,519 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,520 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,520 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,520 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:20,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:20,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 16:16:20,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,621 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 16:16:20,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,622 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689178580321Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689178580543 (+222 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689178580543Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689178580543Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689178580548 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689178580560 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689178580621 (+61 ms) 2023-07-12 16:16:20,625 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 16:16:20,626 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:20,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 300 msec 2023-07-12 16:16:20,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 16:16:20,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:16:20,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44777] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:16:20,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41787] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 16:16:20,634 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,634 DEBUG [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:20,634 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 16:16:20,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1583): Client=jenkins//172.31.10.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 16:16:20,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689178580657 (current time:1689178580657). 2023-07-12 16:16:20,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 16:16:20,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x24e88f0a to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:20,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3298c99b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:20,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:20,671 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:20,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24e88f0a to 127.0.0.1:53717 2023-07-12 16:16:20,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:20,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(139): Connect 0x675c1d51 to 127.0.0.1:53717 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 16:16:20,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72c5e6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 16:16:20,727 DEBUG [hconnection-0x738c8b00-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:20,732 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:39756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:20,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 16:16:20,756 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.10.131:56122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 16:16:20,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x675c1d51 to 127.0.0.1:53717 2023-07-12 16:16:20,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:16:20,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 16:16:20,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 16:16:20,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 16:16:20,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 16:16:20,765 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 16:16:20,766 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689179180766 2023-07-12 16:16:20,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 16:16:20,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,766 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 16:16:20,769 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 16:16:20,771 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 16:16:20,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 16:16:20,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-12 16:16:20,773 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 16:16:20,774 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689179180774 2023-07-12 16:16:20,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,809 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 16:16:20,809 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,810 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 16:16:20,810 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 16:16:20,811 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,811 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,812 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,812 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,812 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,812 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:20,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:20,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:20,813 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,813 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,813 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,813 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 16:16:20,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 16:16:20,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,814 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 16:16:20,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 16:16:20,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 16:16:20,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,815 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 16:16:20,815 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 16:16:20,815 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,815 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,815 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 16:16:20,815 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,815 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 16:16:20,815 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,815 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,815 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 16:16:20,817 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 16:16:20,819 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 16:16:20,817 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 16:16:20,819 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 16:16:20,819 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 16:16:20,819 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,43171,1689178459521' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 16:16:20,819 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 16:16:20,823 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 16:16:20,823 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 16:16:20,823 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 16:16:20,823 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,823 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,823 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,823 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,823 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,824 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:20,824 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:20,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,825 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,825 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,825 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,825 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 16:16:20,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,41787,1689178459474' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 16:16:20,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38883237[Count = 1] remaining members to acquire global barrier 2023-07-12 16:16:20,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:20,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:20,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:20,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:20,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:20,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:20,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase5.apache.org,44777,1689178459404' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 16:16:20,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38883237[Count = 0] remaining members to acquire global barrier 2023-07-12 16:16:20,830 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 16:16:20,830 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,835 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,835 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 16:16:20,836 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:20,836 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:20,836 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 16:16:20,836 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:20,836 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:20,836 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:20,836 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. started... 2023-07-12 16:16:20,836 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 335ae7356576466ade560c8582a48e7e 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 16:16:20,837 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,837 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 16:16:20,838 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 16:16:20,838 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 16:16:20,838 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,838 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:20,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,838 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. started... 2023-07-12 16:16:20,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,838 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 16:16:20,838 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 16:16:20,838 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,43171,1689178459521' in zk 2023-07-12 16:16:20,839 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2745): Flushing be79aec1922b3a1a513039a766391da8 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 16:16:20,841 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 16:16:20,841 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:20,841 DEBUG [member: 'jenkins-hbase5.apache.org,43171,1689178459521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 16:16:20,871 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:20,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 16:16:20,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:16:20,873 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 16:16:20,949 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307127ee8256bae934b958011785f978be755 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307127ee8256bae934b958011785f978be755 2023-07-12 16:16:20,963 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712e547c6f6493645e08c46c291176fece4 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712e547c6f6493645e08c46c291176fece4 2023-07-12 16:16:20,969 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/.tmp/cf/1785038f94544808a480b59bb0f9b426 2023-07-12 16:16:20,974 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/.tmp/cf/fbfbf2b326054a708bcca2e60592cf35 2023-07-12 16:16:20,979 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/.tmp/cf/1785038f94544808a480b59bb0f9b426 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/cf/1785038f94544808a480b59bb0f9b426 2023-07-12 16:16:20,980 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/.tmp/cf/fbfbf2b326054a708bcca2e60592cf35 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/cf/fbfbf2b326054a708bcca2e60592cf35 2023-07-12 16:16:20,987 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/cf/fbfbf2b326054a708bcca2e60592cf35, entries=4, sequenceid=6, filesize=5.6 K 2023-07-12 16:16:20,987 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/cf/1785038f94544808a480b59bb0f9b426, entries=46, sequenceid=6, filesize=13.2 K 2023-07-12 16:16:20,988 INFO [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for be79aec1922b3a1a513039a766391da8 in 149ms, sequenceid=6, compaction requested=false 2023-07-12 16:16:20,988 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 16:16:20,988 INFO [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 335ae7356576466ade560c8582a48e7e in 152ms, sequenceid=6, compaction requested=false 2023-07-12 16:16:20,988 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 16:16:20,991 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for be79aec1922b3a1a513039a766391da8: 2023-07-12 16:16:20,993 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 335ae7356576466ade560c8582a48e7e: 2023-07-12 16:16:20,993 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,993 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,993 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:20,993 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 16:16:20,993 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/cf/fbfbf2b326054a708bcca2e60592cf35] hfiles 2023-07-12 16:16:20,994 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/cf/fbfbf2b326054a708bcca2e60592cf35 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:20,994 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/cf/1785038f94544808a480b59bb0f9b426] hfiles 2023-07-12 16:16:20,994 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/cf/1785038f94544808a480b59bb0f9b426 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,073 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:21,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 16:16:21,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 16:16:21,075 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 16:16:21,083 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. completed. 2023-07-12 16:16:21,084 DEBUG [rs(jenkins-hbase5.apache.org,41787,1689178459474)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:21,084 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:21,084 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:21,084 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:21,084 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 16:16:21,084 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,41787,1689178459474' in zk 2023-07-12 16:16:21,087 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. completed. 2023-07-12 16:16:21,087 DEBUG [rs(jenkins-hbase5.apache.org,44777,1689178459404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:21,087 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 16:16:21,087 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 16:16:21,087 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:21,087 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 16:16:21,087 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase5.apache.org,44777,1689178459404' in zk 2023-07-12 16:16:21,092 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:21,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:21,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:21,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:21,093 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 16:16:21,093 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:21,093 DEBUG [member: 'jenkins-hbase5.apache.org,41787,1689178459474' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 16:16:21,095 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:21,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:21,095 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 16:16:21,095 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:21,095 DEBUG [member: 'jenkins-hbase5.apache.org,44777,1689178459404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 16:16:21,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:21,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:21,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:21,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:21,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:21,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:21,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:21,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase5.apache.org,41787,1689178459474': 2023-07-12 16:16:21,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,41787,1689178459474' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 16:16:21,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:21,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:21,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:21,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:21,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:21,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:21,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:21,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:21,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:21,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:21,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:21,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:21,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase5.apache.org,44777,1689178459404': 2023-07-12 16:16:21,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase5.apache.org,44777,1689178459404' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 16:16:21,109 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 16:16:21,109 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 16:16:21,109 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 16:16:21,109 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,109 INFO [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 16:16:21,111 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,111 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:21,111 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,111 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,111 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 16:16:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 16:16:21,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,112 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:21,111 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:21,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:21,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:21,113 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:21,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:21,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:21,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:21,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:21,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 16:16:21,113 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:21,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,114 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:21,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 16:16:21,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:21,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:21,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:21,116 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:21,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 16:16:21,117 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:21,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,117 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:21,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:21,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:21,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:21,121 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:21,121 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,121 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:21,121 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:21,121 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:21,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:21,121 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 16:16:21,121 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:21,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:21,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:21,121 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:21,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 16:16:21,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:21,121 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:21,121 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,121 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 16:16:21,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 16:16:21,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:21,122 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:21,122 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,122 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:16:21,122 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:21,122 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,122 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:21,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:21,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 16:16:21,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:21,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 16:16:21,123 DEBUG [(jenkins-hbase5.apache.org,43373,1689178457825)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 16:16:21,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 16:16:21,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307127ee8256bae934b958011785f978be755, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712e547c6f6493645e08c46c291176fece4] mob files 2023-07-12 16:16:21,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307127ee8256bae934b958011785f978be755 2023-07-12 16:16:21,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712e547c6f6493645e08c46c291176fece4 2023-07-12 16:16:21,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,270 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 16:16:21,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,271 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase5:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689178580766Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689178581164 (+398 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689178581164Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689178581164Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689178581173 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689178581192 (+19 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689178581270 (+78 ms) 2023-07-12 16:16:21,275 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 16:16:21,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 507 msec 2023-07-12 16:16:21,375 DEBUG [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 16:16:21,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 16:16:21,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 16:16:21,376 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178581376 2023-07-12 16:16:21,376 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:46851, tgtDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178581376, rawTgtDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178581376, srcFsUri=hdfs://localhost:46851, srcDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:16:21,411 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756 2023-07-12 16:16:21,411 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_680123097_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178581376, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178581376/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,411 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:46851, inputRoot=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756, snapshotDir=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-12 16:16:21,460 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178581376/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:21,568 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:21,569 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:21,569 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:21,570 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,736 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-6531131064671705333.jar 2023-07-12 16:16:22,736 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,737 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,821 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/hadoop-8909769594526632023.jar 2023-07-12 16:16:22,821 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,822 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,823 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,823 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,824 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,824 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 16:16:22,825 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 16:16:22,825 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 16:16:22,826 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 16:16:22,826 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 16:16:22,827 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 16:16:22,828 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 16:16:22,828 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 16:16:22,828 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 16:16:22,829 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 16:16:22,829 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 16:16:22,830 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:22,830 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:22,831 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:16:22,831 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:22,832 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 16:16:22,832 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:16:22,833 DEBUG [Listener at jenkins-hbase5.apache.org/37867] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 16:16:23,461 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0006_000001 (auth:SIMPLE) 2023-07-12 16:16:23,926 WARN [Listener at jenkins-hbase5.apache.org/37867] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 16:16:23,928 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-12 16:16:23,930 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-12 16:16:23,999 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:16:23,999 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 16:16:24,469 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0007_000001 (auth:SIMPLE) 2023-07-12 16:16:24,810 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:16:30,889 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0007_000001 (auth:SIMPLE) 2023-07-12 16:16:33,181 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0007_000001 (auth:SIMPLE) 2023-07-12 16:16:37,542 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689178468554_0007_000001 (auth:SIMPLE) 2023-07-12 16:16:39,177 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 16:16:39,177 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 16:16:39,193 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,193 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 16:16:39,194 INFO [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 16:16:39,194 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-454504975_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,195 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 16:16:39,195 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 16:16:39,195 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-454504975_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178581376/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178581376/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,195 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178581376/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 16:16:39,195 DEBUG [Listener at jenkins-hbase5.apache.org/37867] snapshot.TestExportSnapshot(367): hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/export-test/export-1689178581376/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 16:16:39,201 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.HMaster$11(2418): Client=jenkins//172.31.10.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 16:16:39,206 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178599206"}]},"ts":"1689178599206"} 2023-07-12 16:16:39,207 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-12 16:16:39,209 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-12 16:16:39,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be79aec1922b3a1a513039a766391da8, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335ae7356576466ade560c8582a48e7e, UNASSIGN}] 2023-07-12 16:16:39,212 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335ae7356576466ade560c8582a48e7e, UNASSIGN 2023-07-12 16:16:39,212 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be79aec1922b3a1a513039a766391da8, UNASSIGN 2023-07-12 16:16:39,213 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=335ae7356576466ade560c8582a48e7e, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:16:39,213 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=be79aec1922b3a1a513039a766391da8, regionState=CLOSING, regionLocation=jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:16:39,213 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178599213"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178599213"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178599213"}]},"ts":"1689178599213"} 2023-07-12 16:16:39,213 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178599213"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689178599213"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689178599213"}]},"ts":"1689178599213"} 2023-07-12 16:16:39,215 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 335ae7356576466ade560c8582a48e7e, server=jenkins-hbase5.apache.org,41787,1689178459474}] 2023-07-12 16:16:39,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure be79aec1922b3a1a513039a766391da8, server=jenkins-hbase5.apache.org,44777,1689178459404}] 2023-07-12 16:16:39,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 16:16:39,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close 335ae7356576466ade560c8582a48e7e 2023-07-12 16:16:39,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 335ae7356576466ade560c8582a48e7e, disabling compactions & flushes 2023-07-12 16:16:39,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:39,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:39,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. after waiting 0 ms 2023-07-12 16:16:39,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:39,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(111): Close be79aec1922b3a1a513039a766391da8 2023-07-12 16:16:39,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing be79aec1922b3a1a513039a766391da8, disabling compactions & flushes 2023-07-12 16:16:39,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:39,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:39,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. after waiting 0 ms 2023-07-12 16:16:39,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:39,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:16:39,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:39,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e. 2023-07-12 16:16:39,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 335ae7356576466ade560c8582a48e7e: 2023-07-12 16:16:39,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:16:39,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:16:39,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8. 2023-07-12 16:16:39,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for be79aec1922b3a1a513039a766391da8: 2023-07-12 16:16:39,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed 335ae7356576466ade560c8582a48e7e 2023-07-12 16:16:39,385 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=335ae7356576466ade560c8582a48e7e, regionState=CLOSED 2023-07-12 16:16:39,385 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178599385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178599385"}]},"ts":"1689178599385"} 2023-07-12 16:16:39,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.UnassignRegionHandler(149): Closed be79aec1922b3a1a513039a766391da8 2023-07-12 16:16:39,386 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=be79aec1922b3a1a513039a766391da8, regionState=CLOSED 2023-07-12 16:16:39,386 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689178599386"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689178599386"}]},"ts":"1689178599386"} 2023-07-12 16:16:39,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-12 16:16:39,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 335ae7356576466ade560c8582a48e7e, server=jenkins-hbase5.apache.org,41787,1689178459474 in 173 msec 2023-07-12 16:16:39,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-12 16:16:39,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure be79aec1922b3a1a513039a766391da8, server=jenkins-hbase5.apache.org,44777,1689178459404 in 171 msec 2023-07-12 16:16:39,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335ae7356576466ade560c8582a48e7e, UNASSIGN in 179 msec 2023-07-12 16:16:39,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-12 16:16:39,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=be79aec1922b3a1a513039a766391da8, UNASSIGN in 180 msec 2023-07-12 16:16:39,391 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689178599391"}]},"ts":"1689178599391"} 2023-07-12 16:16:39,392 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-12 16:16:39,394 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-12 16:16:39,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 193 msec 2023-07-12 16:16:39,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 16:16:39,508 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-12 16:16:39,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.HMaster$5(2228): Client=jenkins//172.31.10.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,512 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,513 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,514 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44777] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,517 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8 2023-07-12 16:16:39,517 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e 2023-07-12 16:16:39,517 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,518 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,518 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,518 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,518 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 16:16:39,518 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 16:16:39,518 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 16:16:39,518 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 16:16:39,519 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,519 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,519 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,519 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:39,519 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,519 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:39,519 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:39,519 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 16:16:39,520 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/recovered.edits] 2023-07-12 16:16:39,520 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/cf, FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/recovered.edits] 2023-07-12 16:16:39,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 16:16:39,524 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/cf/1785038f94544808a480b59bb0f9b426 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/cf/1785038f94544808a480b59bb0f9b426 2023-07-12 16:16:39,524 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/cf/fbfbf2b326054a708bcca2e60592cf35 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/cf/fbfbf2b326054a708bcca2e60592cf35 2023-07-12 16:16:39,527 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/recovered.edits/9.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e/recovered.edits/9.seqid 2023-07-12 16:16:39,528 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/recovered.edits/9.seqid to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8/recovered.edits/9.seqid 2023-07-12 16:16:39,528 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335ae7356576466ade560c8582a48e7e 2023-07-12 16:16:39,528 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/be79aec1922b3a1a513039a766391da8 2023-07-12 16:16:39,528 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 16:16:39,529 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 16:16:39,530 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-12 16:16:39,533 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307127ee8256bae934b958011785f978be755 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307127ee8256bae934b958011785f978be755 2023-07-12 16:16:39,534 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712e547c6f6493645e08c46c291176fece4 to hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712e547c6f6493645e08c46c291176fece4 2023-07-12 16:16:39,534 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 16:16:39,536 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,538 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-12 16:16:39,540 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-12 16:16:39,541 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,541 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-12 16:16:39,541 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178599541"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:39,541 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689178599541"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:39,543 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 16:16:39,543 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => be79aec1922b3a1a513039a766391da8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689178579576.be79aec1922b3a1a513039a766391da8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 335ae7356576466ade560c8582a48e7e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689178579576.335ae7356576466ade560c8582a48e7e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 16:16:39,543 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-12 16:16:39,543 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689178599543"}]},"ts":"9223372036854775807"} 2023-07-12 16:16:39,546 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-12 16:16:39,548 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 39 msec 2023-07-12 16:16:39,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 16:16:39,622 INFO [Listener at jenkins-hbase5.apache.org/37867] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-12 16:16:39,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 16:16:39,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] master.MasterRpcServices(751): Client=jenkins//172.31.10.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 16:16:39,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43373] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 16:16:39,705 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 760) Potentially hanging thread: hconnection-0x77775a31-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:43882 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5320 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:33118 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-454504975_17 at /127.0.0.1:60112 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-769442911_1 at /127.0.0.1:60094 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase5:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77775a31-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase5.apache.org/172.31.10.131:37805 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=898 (was 907), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=593 (was 616), ProcessCount=171 (was 171), AvailableMemoryMB=2182 (was 3598) 2023-07-12 16:16:39,705 WARN [Listener at jenkins-hbase5.apache.org/37867] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 16:16:39,705 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-12 16:16:39,751 INFO [Listener at jenkins-hbase5.apache.org/37867] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:0 2023-07-12 16:16:39,863 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689178468554_0007_01_000001 is : 143 2023-07-12 16:16:44,955 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 16:16:53,883 INFO [Listener at jenkins-hbase5.apache.org/37867] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:0 2023-07-12 16:17:08,008 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 16:17:08,009 INFO [Listener at jenkins-hbase5.apache.org/37867] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:0 2023-07-12 16:17:08,126 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-12 16:17:08,139 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-12 16:17:08,141 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 16:17:08,155 INFO [Listener at jenkins-hbase5.apache.org/37867] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase5.apache.org:0 2023-07-12 16:17:08,260 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 16:17:08,260 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-12 16:17:08,260 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 16:17:08,260 INFO [Listener at jenkins-hbase5.apache.org/37867] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 16:17:08,260 DEBUG [Listener at jenkins-hbase5.apache.org/37867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52f9184c to 127.0.0.1:53717 2023-07-12 16:17:08,260 DEBUG [Listener at jenkins-hbase5.apache.org/37867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,260 DEBUG [Listener at jenkins-hbase5.apache.org/37867] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 16:17:08,261 DEBUG [Listener at jenkins-hbase5.apache.org/37867] util.JVMClusterUtil(257): Found active master hash=1678616187, stopped=false 2023-07-12 16:17:08,261 DEBUG [Listener at jenkins-hbase5.apache.org/37867] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:08,261 DEBUG [Listener at jenkins-hbase5.apache.org/37867] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 16:17:08,261 INFO [Listener at jenkins-hbase5.apache.org/37867] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase5.apache.org,43373,1689178457825 2023-07-12 16:17:08,263 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 16:17:08,263 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 16:17:08,263 INFO [Listener at jenkins-hbase5.apache.org/37867] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 16:17:08,263 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 16:17:08,263 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 16:17:08,263 DEBUG [Listener at jenkins-hbase5.apache.org/37867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02020cb0 to 127.0.0.1:53717 2023-07-12 16:17:08,263 DEBUG [Listener at jenkins-hbase5.apache.org/37867] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,263 INFO [Listener at jenkins-hbase5.apache.org/37867] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,44777,1689178459404' ***** 2023-07-12 16:17:08,263 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:17:08,263 DEBUG [Listener at jenkins-hbase5.apache.org/37867] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:08,264 INFO [Listener at jenkins-hbase5.apache.org/37867] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 16:17:08,264 INFO [Listener at jenkins-hbase5.apache.org/37867] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,41787,1689178459474' ***** 2023-07-12 16:17:08,264 DEBUG [Listener at jenkins-hbase5.apache.org/37867] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:08,264 INFO [Listener at jenkins-hbase5.apache.org/37867] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 16:17:08,264 INFO [Listener at jenkins-hbase5.apache.org/37867] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,43171,1689178459521' ***** 2023-07-12 16:17:08,264 DEBUG [Listener at jenkins-hbase5.apache.org/37867] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:08,265 INFO [Listener at jenkins-hbase5.apache.org/37867] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 16:17:08,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:17:08,265 INFO [RS:2;jenkins-hbase5:43171] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 16:17:08,265 INFO [RS:2;jenkins-hbase5:43171] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 16:17:08,265 INFO [RS:2;jenkins-hbase5:43171] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 16:17:08,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:17:08,265 INFO [RS:0;jenkins-hbase5:44777] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 16:17:08,265 INFO [RS:1;jenkins-hbase5:41787] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 16:17:08,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:17:08,265 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 16:17:08,265 INFO [RS:1;jenkins-hbase5:41787] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 16:17:08,266 INFO [RS:1;jenkins-hbase5:41787] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 16:17:08,265 INFO [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(3305): Received CLOSE for e92498b243419952ff4283dbf667589c 2023-07-12 16:17:08,265 INFO [RS:0;jenkins-hbase5:44777] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 16:17:08,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 16:17:08,266 INFO [RS:0;jenkins-hbase5:44777] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 16:17:08,266 INFO [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:17:08,266 INFO [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:17:08,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing e92498b243419952ff4283dbf667589c, disabling compactions & flushes 2023-07-12 16:17:08,265 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 16:17:08,265 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 16:17:08,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. 2023-07-12 16:17:08,267 DEBUG [RS:1;jenkins-hbase5:41787] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ddad224 to 127.0.0.1:53717 2023-07-12 16:17:08,266 DEBUG [RS:2;jenkins-hbase5:43171] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c075bd0 to 127.0.0.1:53717 2023-07-12 16:17:08,266 INFO [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(3305): Received CLOSE for a749775b4a9fe382b9fe214518989c64 2023-07-12 16:17:08,268 DEBUG [RS:2;jenkins-hbase5:43171] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,268 INFO [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:17:08,267 DEBUG [RS:1;jenkins-hbase5:41787] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. 2023-07-12 16:17:08,270 INFO [RS:1;jenkins-hbase5:41787] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 16:17:08,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. after waiting 0 ms 2023-07-12 16:17:08,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing a749775b4a9fe382b9fe214518989c64, disabling compactions & flushes 2023-07-12 16:17:08,270 INFO [RS:1;jenkins-hbase5:41787] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 16:17:08,271 INFO [RS:1;jenkins-hbase5:41787] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 16:17:08,270 INFO [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 16:17:08,268 DEBUG [RS:0;jenkins-hbase5:44777] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2079b8bc to 127.0.0.1:53717 2023-07-12 16:17:08,271 DEBUG [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(1478): Online Regions={e92498b243419952ff4283dbf667589c=hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c.} 2023-07-12 16:17:08,271 DEBUG [RS:0;jenkins-hbase5:44777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,271 INFO [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 16:17:08,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. 2023-07-12 16:17:08,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. 2023-07-12 16:17:08,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. 2023-07-12 16:17:08,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing e92498b243419952ff4283dbf667589c 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 16:17:08,272 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 16:17:08,272 INFO [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 16:17:08,272 INFO [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 16:17:08,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. after waiting 0 ms 2023-07-12 16:17:08,272 DEBUG [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(1478): Online Regions={a749775b4a9fe382b9fe214518989c64=hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64.} 2023-07-12 16:17:08,272 DEBUG [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-12 16:17:08,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. 2023-07-12 16:17:08,273 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 16:17:08,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing a749775b4a9fe382b9fe214518989c64 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-12 16:17:08,273 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 16:17:08,273 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 16:17:08,273 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 16:17:08,273 DEBUG [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(1504): Waiting on e92498b243419952ff4283dbf667589c 2023-07-12 16:17:08,273 DEBUG [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 16:17:08,273 DEBUG [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(1504): Waiting on a749775b4a9fe382b9fe214518989c64 2023-07-12 16:17:08,273 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 16:17:08,273 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-12 16:17:08,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/acl/a749775b4a9fe382b9fe214518989c64/.tmp/l/788f509718ae4dd6af4c788b2cc45623 2023-07-12 16:17:08,307 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/.tmp/info/970fad5177e947b0b1ffc345f25978eb 2023-07-12 16:17:08,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 788f509718ae4dd6af4c788b2cc45623 2023-07-12 16:17:08,312 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 970fad5177e947b0b1ffc345f25978eb 2023-07-12 16:17:08,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/acl/a749775b4a9fe382b9fe214518989c64/.tmp/l/788f509718ae4dd6af4c788b2cc45623 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/acl/a749775b4a9fe382b9fe214518989c64/l/788f509718ae4dd6af4c788b2cc45623 2023-07-12 16:17:08,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/namespace/e92498b243419952ff4283dbf667589c/.tmp/info/4027fff43e4342089db46543baebcc18 2023-07-12 16:17:08,317 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 16:17:08,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 788f509718ae4dd6af4c788b2cc45623 2023-07-12 16:17:08,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/acl/a749775b4a9fe382b9fe214518989c64/l/788f509718ae4dd6af4c788b2cc45623, entries=7, sequenceid=18, filesize=5.2 K 2023-07-12 16:17:08,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/namespace/e92498b243419952ff4283dbf667589c/.tmp/info/4027fff43e4342089db46543baebcc18 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/namespace/e92498b243419952ff4283dbf667589c/info/4027fff43e4342089db46543baebcc18 2023-07-12 16:17:08,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for a749775b4a9fe382b9fe214518989c64 in 51ms, sequenceid=18, compaction requested=false 2023-07-12 16:17:08,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/namespace/e92498b243419952ff4283dbf667589c/info/4027fff43e4342089db46543baebcc18, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 16:17:08,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e92498b243419952ff4283dbf667589c in 57ms, sequenceid=6, compaction requested=false 2023-07-12 16:17:08,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/acl/a749775b4a9fe382b9fe214518989c64/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-12 16:17:08,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:08,332 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/.tmp/rep_barrier/670ebba997274b51ae27502a6487e61e 2023-07-12 16:17:08,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. 2023-07-12 16:17:08,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for a749775b4a9fe382b9fe214518989c64: 2023-07-12 16:17:08,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689178463184.a749775b4a9fe382b9fe214518989c64. 2023-07-12 16:17:08,339 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 670ebba997274b51ae27502a6487e61e 2023-07-12 16:17:08,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/namespace/e92498b243419952ff4283dbf667589c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 16:17:08,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:08,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. 2023-07-12 16:17:08,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for e92498b243419952ff4283dbf667589c: 2023-07-12 16:17:08,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689178462314.e92498b243419952ff4283dbf667589c. 2023-07-12 16:17:08,346 INFO [regionserver/jenkins-hbase5:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 16:17:08,376 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/.tmp/table/bdd4bc5df500439598cf27cf63c03d00 2023-07-12 16:17:08,381 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bdd4bc5df500439598cf27cf63c03d00 2023-07-12 16:17:08,382 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/.tmp/info/970fad5177e947b0b1ffc345f25978eb as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/info/970fad5177e947b0b1ffc345f25978eb 2023-07-12 16:17:08,388 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 970fad5177e947b0b1ffc345f25978eb 2023-07-12 16:17:08,388 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/info/970fad5177e947b0b1ffc345f25978eb, entries=48, sequenceid=131, filesize=10.3 K 2023-07-12 16:17:08,389 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/.tmp/rep_barrier/670ebba997274b51ae27502a6487e61e as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/rep_barrier/670ebba997274b51ae27502a6487e61e 2023-07-12 16:17:08,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 670ebba997274b51ae27502a6487e61e 2023-07-12 16:17:08,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/rep_barrier/670ebba997274b51ae27502a6487e61e, entries=13, sequenceid=131, filesize=6.4 K 2023-07-12 16:17:08,395 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/.tmp/table/bdd4bc5df500439598cf27cf63c03d00 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/table/bdd4bc5df500439598cf27cf63c03d00 2023-07-12 16:17:08,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bdd4bc5df500439598cf27cf63c03d00 2023-07-12 16:17:08,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/table/bdd4bc5df500439598cf27cf63c03d00, entries=24, sequenceid=131, filesize=6.9 K 2023-07-12 16:17:08,401 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 128ms, sequenceid=131, compaction requested=false 2023-07-12 16:17:08,410 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-12 16:17:08,411 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 16:17:08,411 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 16:17:08,411 INFO [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 16:17:08,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 16:17:08,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase5:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 16:17:08,473 INFO [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,43171,1689178459521; all regions closed. 2023-07-12 16:17:08,473 INFO [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,41787,1689178459474; all regions closed. 2023-07-12 16:17:08,473 INFO [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,44777,1689178459404; all regions closed. 2023-07-12 16:17:08,486 DEBUG [RS:0;jenkins-hbase5:44777] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/oldWALs 2023-07-12 16:17:08,486 INFO [RS:0;jenkins-hbase5:44777] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C44777%2C1689178459404:(num 1689178461754) 2023-07-12 16:17:08,486 DEBUG [RS:1;jenkins-hbase5:41787] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/oldWALs 2023-07-12 16:17:08,486 DEBUG [RS:0;jenkins-hbase5:44777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,486 INFO [RS:1;jenkins-hbase5:41787] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C41787%2C1689178459474.meta:.meta(num 1689178461943) 2023-07-12 16:17:08,486 INFO [RS:0;jenkins-hbase5:44777] regionserver.LeaseManager(133): Closed leases 2023-07-12 16:17:08,486 INFO [RS:0;jenkins-hbase5:44777] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 16:17:08,487 INFO [RS:0;jenkins-hbase5:44777] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 16:17:08,487 INFO [RS:0;jenkins-hbase5:44777] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 16:17:08,487 INFO [RS:0;jenkins-hbase5:44777] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 16:17:08,487 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 16:17:08,488 INFO [RS:0;jenkins-hbase5:44777] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:44777 2023-07-12 16:17:08,491 DEBUG [RS:2;jenkins-hbase5:43171] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/oldWALs 2023-07-12 16:17:08,491 INFO [RS:2;jenkins-hbase5:43171] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C43171%2C1689178459521:(num 1689178461759) 2023-07-12 16:17:08,491 DEBUG [RS:2;jenkins-hbase5:43171] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,491 INFO [RS:2;jenkins-hbase5:43171] regionserver.LeaseManager(133): Closed leases 2023-07-12 16:17:08,491 INFO [RS:2;jenkins-hbase5:43171] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 16:17:08,491 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/WALs/jenkins-hbase5.apache.org,41787,1689178459474/jenkins-hbase5.apache.org%2C41787%2C1689178459474.1689178461759 not finished, retry = 0 2023-07-12 16:17:08,493 INFO [RS:2;jenkins-hbase5:43171] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 16:17:08,493 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 16:17:08,493 INFO [RS:2;jenkins-hbase5:43171] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 16:17:08,493 INFO [RS:2;jenkins-hbase5:43171] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 16:17:08,494 INFO [RS:2;jenkins-hbase5:43171] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:43171 2023-07-12 16:17:08,497 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:17:08,497 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 16:17:08,497 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 16:17:08,497 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:17:08,497 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 16:17:08,497 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,43171,1689178459521 2023-07-12 16:17:08,497 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 16:17:08,499 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:17:08,499 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:17:08,499 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,44777,1689178459404 2023-07-12 16:17:08,500 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,44777,1689178459404] 2023-07-12 16:17:08,500 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,44777,1689178459404; numProcessing=1 2023-07-12 16:17:08,501 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,44777,1689178459404 already deleted, retry=false 2023-07-12 16:17:08,501 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,44777,1689178459404 expired; onlineServers=2 2023-07-12 16:17:08,501 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,43171,1689178459521] 2023-07-12 16:17:08,501 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,43171,1689178459521; numProcessing=2 2023-07-12 16:17:08,503 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,43171,1689178459521 already deleted, retry=false 2023-07-12 16:17:08,503 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,43171,1689178459521 expired; onlineServers=1 2023-07-12 16:17:08,564 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 16:17:08,564 INFO [regionserver/jenkins-hbase5:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 16:17:08,594 DEBUG [RS:1;jenkins-hbase5:41787] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/oldWALs 2023-07-12 16:17:08,594 INFO [RS:1;jenkins-hbase5:41787] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase5.apache.org%2C41787%2C1689178459474:(num 1689178461759) 2023-07-12 16:17:08,594 DEBUG [RS:1;jenkins-hbase5:41787] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,594 INFO [RS:1;jenkins-hbase5:41787] regionserver.LeaseManager(133): Closed leases 2023-07-12 16:17:08,594 INFO [RS:1;jenkins-hbase5:41787] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase5:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 16:17:08,594 INFO [regionserver/jenkins-hbase5:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 16:17:08,595 INFO [RS:1;jenkins-hbase5:41787] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:41787 2023-07-12 16:17:08,597 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase5.apache.org,41787,1689178459474 2023-07-12 16:17:08,597 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 16:17:08,598 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase5.apache.org,41787,1689178459474] 2023-07-12 16:17:08,598 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase5.apache.org,41787,1689178459474; numProcessing=3 2023-07-12 16:17:08,599 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase5.apache.org,41787,1689178459474 already deleted, retry=false 2023-07-12 16:17:08,599 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase5.apache.org,41787,1689178459474 expired; onlineServers=0 2023-07-12 16:17:08,599 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase5.apache.org,43373,1689178457825' ***** 2023-07-12 16:17:08,599 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 16:17:08,600 DEBUG [M:0;jenkins-hbase5:43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2530ac40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase5.apache.org/172.31.10.131:0 2023-07-12 16:17:08,600 INFO [M:0;jenkins-hbase5:43373] regionserver.HRegionServer(1144): stopping server jenkins-hbase5.apache.org,43373,1689178457825 2023-07-12 16:17:08,600 INFO [M:0;jenkins-hbase5:43373] regionserver.HRegionServer(1170): stopping server jenkins-hbase5.apache.org,43373,1689178457825; all regions closed. 2023-07-12 16:17:08,600 DEBUG [M:0;jenkins-hbase5:43373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 16:17:08,600 DEBUG [M:0;jenkins-hbase5:43373] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 16:17:08,600 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 16:17:08,600 DEBUG [M:0;jenkins-hbase5:43373] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 16:17:08,600 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689178461241] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.large.0-1689178461241,5,FailOnTimeoutGroup] 2023-07-12 16:17:08,600 INFO [RS:2;jenkins-hbase5:43171] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,43171,1689178459521; zookeeper connection closed. 2023-07-12 16:17:08,600 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,600 DEBUG [master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689178461241] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase5:0:becomeActiveMaster-HFileCleaner.small.0-1689178461241,5,FailOnTimeoutGroup] 2023-07-12 16:17:08,600 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:43171-0x101c5ec8d560003, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,600 INFO [M:0;jenkins-hbase5:43373] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 16:17:08,600 INFO [M:0;jenkins-hbase5:43373] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 16:17:08,601 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5f24897a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5f24897a 2023-07-12 16:17:08,601 INFO [M:0;jenkins-hbase5:43373] hbase.ChoreService(369): Chore service for: master/jenkins-hbase5:0 had [] on shutdown 2023-07-12 16:17:08,601 DEBUG [M:0;jenkins-hbase5:43373] master.HMaster(1512): Stopping service threads 2023-07-12 16:17:08,601 INFO [M:0;jenkins-hbase5:43373] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 16:17:08,601 ERROR [M:0;jenkins-hbase5:43373] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-12 16:17:08,602 INFO [M:0;jenkins-hbase5:43373] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 16:17:08,602 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 16:17:08,602 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 16:17:08,603 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 16:17:08,603 DEBUG [M:0;jenkins-hbase5:43373] zookeeper.ZKUtil(398): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 16:17:08,603 WARN [M:0;jenkins-hbase5:43373] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 16:17:08,603 INFO [M:0;jenkins-hbase5:43373] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 16:17:08,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 16:17:08,603 INFO [M:0;jenkins-hbase5:43373] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 16:17:08,604 DEBUG [M:0;jenkins-hbase5:43373] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 16:17:08,604 INFO [M:0;jenkins-hbase5:43373] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:17:08,604 DEBUG [M:0;jenkins-hbase5:43373] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:17:08,604 DEBUG [M:0;jenkins-hbase5:43373] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 16:17:08,604 DEBUG [M:0;jenkins-hbase5:43373] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:17:08,604 INFO [M:0;jenkins-hbase5:43373] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.90 KB heapSize=452.13 KB 2023-07-12 16:17:08,623 INFO [M:0;jenkins-hbase5:43373] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.90 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1d98d84a14734230a329cefae0e61660 2023-07-12 16:17:08,627 INFO [M:0;jenkins-hbase5:43373] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d98d84a14734230a329cefae0e61660 2023-07-12 16:17:08,629 DEBUG [M:0;jenkins-hbase5:43373] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1d98d84a14734230a329cefae0e61660 as hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1d98d84a14734230a329cefae0e61660 2023-07-12 16:17:08,633 INFO [M:0;jenkins-hbase5:43373] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d98d84a14734230a329cefae0e61660 2023-07-12 16:17:08,633 INFO [M:0;jenkins-hbase5:43373] regionserver.HStore(1080): Added hdfs://localhost:46851/user/jenkins/test-data/6f127a80-dcca-be7d-1aeb-cedb778e4756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1d98d84a14734230a329cefae0e61660, entries=119, sequenceid=899, filesize=28.7 K 2023-07-12 16:17:08,634 INFO [M:0;jenkins-hbase5:43373] regionserver.HRegion(2948): Finished flush of dataSize ~375.90 KB/384920, heapSize ~452.11 KB/462960, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=899, compaction requested=false 2023-07-12 16:17:08,635 INFO [M:0;jenkins-hbase5:43373] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 16:17:08,636 DEBUG [M:0;jenkins-hbase5:43373] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 16:17:08,639 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 16:17:08,639 INFO [M:0;jenkins-hbase5:43373] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 16:17:08,639 INFO [M:0;jenkins-hbase5:43373] ipc.NettyRpcServer(158): Stopping server on /172.31.10.131:43373 2023-07-12 16:17:08,640 DEBUG [M:0;jenkins-hbase5:43373] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase5.apache.org,43373,1689178457825 already deleted, retry=false 2023-07-12 16:17:08,700 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,700 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:41787-0x101c5ec8d560002, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,700 INFO [RS:1;jenkins-hbase5:41787] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,41787,1689178459474; zookeeper connection closed. 2023-07-12 16:17:08,701 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6bd2de30] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6bd2de30 2023-07-12 16:17:08,801 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,801 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): regionserver:44777-0x101c5ec8d560001, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,801 INFO [RS:0;jenkins-hbase5:44777] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,44777,1689178459404; zookeeper connection closed. 2023-07-12 16:17:08,801 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@289f8297] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@289f8297 2023-07-12 16:17:08,801 INFO [Listener at jenkins-hbase5.apache.org/37867] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 16:17:08,901 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,901 INFO [M:0;jenkins-hbase5:43373] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase5.apache.org,43373,1689178457825; zookeeper connection closed. 2023-07-12 16:17:08,901 DEBUG [Listener at localhost/36467-EventThread] zookeeper.ZKWatcher(600): master:43373-0x101c5ec8d560000, quorum=127.0.0.1:53717, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 16:17:08,903 WARN [Listener at jenkins-hbase5.apache.org/37867] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 16:17:08,906 INFO [Listener at jenkins-hbase5.apache.org/37867] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 16:17:09,012 WARN [BP-2142118440-172.31.10.131-1689178453407 heartbeating to localhost/127.0.0.1:46851] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 16:17:09,012 WARN [BP-2142118440-172.31.10.131-1689178453407 heartbeating to localhost/127.0.0.1:46851] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2142118440-172.31.10.131-1689178453407 (Datanode Uuid 2e1e58fb-1c56-41bf-94a7-d8ec9f8440df) service to localhost/127.0.0.1:46851 2023-07-12 16:17:09,014 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/dfs/data/data5/current/BP-2142118440-172.31.10.131-1689178453407] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 16:17:09,015 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/dfs/data/data6/current/BP-2142118440-172.31.10.131-1689178453407] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 16:17:09,016 WARN [Listener at jenkins-hbase5.apache.org/37867] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 16:17:09,023 INFO [Listener at jenkins-hbase5.apache.org/37867] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 16:17:09,126 WARN [BP-2142118440-172.31.10.131-1689178453407 heartbeating to localhost/127.0.0.1:46851] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 16:17:09,127 WARN [BP-2142118440-172.31.10.131-1689178453407 heartbeating to localhost/127.0.0.1:46851] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2142118440-172.31.10.131-1689178453407 (Datanode Uuid d1957b33-51a1-4bb1-8161-180ae576f319) service to localhost/127.0.0.1:46851 2023-07-12 16:17:09,127 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/dfs/data/data3/current/BP-2142118440-172.31.10.131-1689178453407] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 16:17:09,128 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/dfs/data/data4/current/BP-2142118440-172.31.10.131-1689178453407] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 16:17:09,129 WARN [Listener at jenkins-hbase5.apache.org/37867] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 16:17:09,134 INFO [Listener at jenkins-hbase5.apache.org/37867] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 16:17:09,238 WARN [BP-2142118440-172.31.10.131-1689178453407 heartbeating to localhost/127.0.0.1:46851] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 16:17:09,238 WARN [BP-2142118440-172.31.10.131-1689178453407 heartbeating to localhost/127.0.0.1:46851] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2142118440-172.31.10.131-1689178453407 (Datanode Uuid eae0ca6d-7dbe-41be-adf4-ce191908d896) service to localhost/127.0.0.1:46851 2023-07-12 16:17:09,239 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/dfs/data/data1/current/BP-2142118440-172.31.10.131-1689178453407] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 16:17:09,239 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d67f45d2-7bf2-6f5a-4d70-14d9d0785913/cluster_1813932e-dec0-a2fb-68e1-005ac3d3bd6f/dfs/data/data2/current/BP-2142118440-172.31.10.131-1689178453407] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 16:17:09,262 INFO [Listener at jenkins-hbase5.apache.org/37867] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 16:17:09,389 INFO [Listener at jenkins-hbase5.apache.org/37867] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 16:17:09,486 INFO [Listener at jenkins-hbase5.apache.org/37867] hbase.HBaseTestingUtility(1293): Minicluster is down