2023-09-12 20:59:21,015 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-12 20:59:21,226 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd 2023-09-12 20:59:21,227 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-12 20:59:21,227 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-12 20:59:21,265 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-12 20:59:21,502 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-12 20:59:21,503 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059, deleteOnExit=true 2023-09-12 20:59:21,503 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-12 20:59:21,503 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/test.cache.data in system properties and HBase conf 2023-09-12 20:59:21,504 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop.tmp.dir in system properties and HBase conf 2023-09-12 20:59:21,504 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop.log.dir in system properties and HBase conf 2023-09-12 20:59:21,504 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-12 20:59:21,505 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-12 20:59:21,505 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-12 20:59:21,811 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-12 20:59:21,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-12 20:59:21,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-12 20:59:21,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-12 20:59:21,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-12 20:59:21,817 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-12 20:59:21,817 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-12 20:59:21,818 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-12 20:59:21,818 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-12 20:59:21,818 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-12 20:59:21,819 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/nfs.dump.dir in system properties and HBase conf 2023-09-12 20:59:21,819 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/java.io.tmpdir in system properties and HBase conf 2023-09-12 20:59:21,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-12 20:59:21,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-12 20:59:21,821 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-12 20:59:22,312 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-12 20:59:22,317 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-12 20:59:22,612 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-12 20:59:22,789 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-12 20:59:22,813 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 20:59:22,852 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 20:59:22,885 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/java.io.tmpdir/Jetty_localhost_36421_hdfs____.m0oaau/webapp 2023-09-12 20:59:23,027 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36421 2023-09-12 20:59:23,039 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-12 20:59:23,039 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-12 20:59:23,534 WARN [Listener at localhost/38861] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-12 20:59:23,607 WARN [Listener at localhost/38861] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-12 20:59:23,628 WARN [Listener at localhost/38861] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 20:59:23,688 INFO [Listener at localhost/38861] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 20:59:23,697 INFO [Listener at localhost/38861] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/java.io.tmpdir/Jetty_localhost_45237_datanode____wroeos/webapp 2023-09-12 20:59:23,798 INFO [Listener at localhost/38861] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45237 2023-09-12 20:59:24,207 WARN [Listener at localhost/40477] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-12 20:59:24,220 WARN [Listener at localhost/40477] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-12 20:59:24,224 WARN [Listener at localhost/40477] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 20:59:24,225 INFO [Listener at localhost/40477] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 20:59:24,231 INFO [Listener at localhost/40477] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/java.io.tmpdir/Jetty_localhost_33043_datanode____.bji3wq/webapp 2023-09-12 20:59:24,334 INFO [Listener at localhost/40477] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33043 2023-09-12 20:59:24,345 WARN [Listener at localhost/41417] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-12 20:59:24,359 WARN [Listener at localhost/41417] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-12 20:59:24,362 WARN [Listener at localhost/41417] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 20:59:24,364 INFO [Listener at localhost/41417] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 20:59:24,376 INFO [Listener at localhost/41417] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/java.io.tmpdir/Jetty_localhost_44621_datanode____.yod82s/webapp 2023-09-12 20:59:24,491 INFO [Listener at localhost/41417] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44621 2023-09-12 20:59:24,504 WARN [Listener at localhost/37459] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-12 20:59:24,764 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbd52347291cd52a9: Processing first storage report for DS-f0ae895c-b4db-4260-973a-f32d8e09cf8b from datanode 8a5c3bbd-7ec2-4c29-8218-0466ee1095f6 2023-09-12 20:59:24,766 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbd52347291cd52a9: from storage DS-f0ae895c-b4db-4260-973a-f32d8e09cf8b node DatanodeRegistration(127.0.0.1:43915, datanodeUuid=8a5c3bbd-7ec2-4c29-8218-0466ee1095f6, infoPort=40249, infoSecurePort=0, ipcPort=40477, storageInfo=lv=-57;cid=testClusterID;nsid=1365074869;c=1694552362399), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-12 20:59:24,766 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa8fc6c82dae35e0b: Processing first storage report for DS-66e49a79-df22-4e77-9712-7d5d88c874d6 from datanode d04a1494-5e5e-4e47-8587-b643a1ed77d2 2023-09-12 20:59:24,766 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa8fc6c82dae35e0b: from storage DS-66e49a79-df22-4e77-9712-7d5d88c874d6 node DatanodeRegistration(127.0.0.1:32979, datanodeUuid=d04a1494-5e5e-4e47-8587-b643a1ed77d2, infoPort=37393, infoSecurePort=0, ipcPort=37459, storageInfo=lv=-57;cid=testClusterID;nsid=1365074869;c=1694552362399), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-12 20:59:24,767 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7c4bd93ded89264: Processing first storage report for DS-db87646e-7723-4482-a354-cd3f2414d22c from datanode 73c19682-0241-4472-9972-b38ede35e2ea 2023-09-12 20:59:24,767 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7c4bd93ded89264: from storage DS-db87646e-7723-4482-a354-cd3f2414d22c node DatanodeRegistration(127.0.0.1:43517, datanodeUuid=73c19682-0241-4472-9972-b38ede35e2ea, infoPort=43027, infoSecurePort=0, ipcPort=41417, storageInfo=lv=-57;cid=testClusterID;nsid=1365074869;c=1694552362399), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-12 20:59:24,767 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbd52347291cd52a9: Processing first storage report for DS-b9d6dbf9-e607-4fcd-a325-378ac4dbd90a from datanode 8a5c3bbd-7ec2-4c29-8218-0466ee1095f6 2023-09-12 20:59:24,767 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbd52347291cd52a9: from storage DS-b9d6dbf9-e607-4fcd-a325-378ac4dbd90a node DatanodeRegistration(127.0.0.1:43915, datanodeUuid=8a5c3bbd-7ec2-4c29-8218-0466ee1095f6, infoPort=40249, infoSecurePort=0, ipcPort=40477, storageInfo=lv=-57;cid=testClusterID;nsid=1365074869;c=1694552362399), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-12 20:59:24,767 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa8fc6c82dae35e0b: Processing first storage report for DS-6b1ab6d6-9746-47d1-8901-7a17770776bb from datanode d04a1494-5e5e-4e47-8587-b643a1ed77d2 2023-09-12 20:59:24,767 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa8fc6c82dae35e0b: from storage DS-6b1ab6d6-9746-47d1-8901-7a17770776bb node DatanodeRegistration(127.0.0.1:32979, datanodeUuid=d04a1494-5e5e-4e47-8587-b643a1ed77d2, infoPort=37393, infoSecurePort=0, ipcPort=37459, storageInfo=lv=-57;cid=testClusterID;nsid=1365074869;c=1694552362399), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-12 20:59:24,768 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7c4bd93ded89264: Processing first storage report for DS-c838f47e-0cf2-4af6-ad95-a34fe06dd500 from datanode 73c19682-0241-4472-9972-b38ede35e2ea 2023-09-12 20:59:24,768 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7c4bd93ded89264: from storage DS-c838f47e-0cf2-4af6-ad95-a34fe06dd500 node DatanodeRegistration(127.0.0.1:43517, datanodeUuid=73c19682-0241-4472-9972-b38ede35e2ea, infoPort=43027, infoSecurePort=0, ipcPort=41417, storageInfo=lv=-57;cid=testClusterID;nsid=1365074869;c=1694552362399), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-12 20:59:24,970 DEBUG [Listener at localhost/37459] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd 2023-09-12 20:59:25,078 INFO [Listener at localhost/37459] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/zookeeper_0, clientPort=58083, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-12 20:59:25,105 INFO [Listener at localhost/37459] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58083 2023-09-12 20:59:25,113 INFO [Listener at localhost/37459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 20:59:25,116 INFO [Listener at localhost/37459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 20:59:25,816 INFO [Listener at localhost/37459] util.FSUtils(471): Created version file at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 with version=8 2023-09-12 20:59:25,817 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/hbase-staging 2023-09-12 20:59:26,195 INFO [Listener at localhost/37459] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-12 20:59:26,669 INFO [Listener at localhost/37459] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-09-12 20:59:26,701 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 20:59:26,701 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-12 20:59:26,701 INFO [Listener at localhost/37459] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-12 20:59:26,702 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 20:59:26,702 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-12 20:59:26,839 INFO [Listener at localhost/37459] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-12 20:59:26,910 DEBUG [Listener at localhost/37459] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-12 20:59:27,000 INFO [Listener at localhost/37459] ipc.NettyRpcServer(120): Bind to /172.31.2.10:38453 2023-09-12 20:59:27,013 INFO [Listener at localhost/37459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 20:59:27,015 INFO [Listener at localhost/37459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 20:59:27,039 INFO [Listener at localhost/37459] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38453 connecting to ZooKeeper ensemble=127.0.0.1:58083 2023-09-12 20:59:27,104 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:384530x0, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-12 20:59:27,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38453-0x100a1e28c4e0000 connected 2023-09-12 20:59:27,141 DEBUG [Listener at localhost/37459] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-12 20:59:27,142 DEBUG [Listener at localhost/37459] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 20:59:27,160 DEBUG [Listener at localhost/37459] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-12 20:59:27,169 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38453 2023-09-12 20:59:27,169 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38453 2023-09-12 20:59:27,170 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38453 2023-09-12 20:59:27,170 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38453 2023-09-12 20:59:27,170 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38453 2023-09-12 20:59:27,178 INFO [Listener at localhost/37459] master.HMaster(444): hbase.rootdir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944, hbase.cluster.distributed=false 2023-09-12 20:59:27,246 INFO [Listener at localhost/37459] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-09-12 20:59:27,246 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 20:59:27,247 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-12 20:59:27,247 INFO [Listener at localhost/37459] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-12 20:59:27,247 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 20:59:27,247 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-12 20:59:27,252 INFO [Listener at localhost/37459] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-12 20:59:27,255 INFO [Listener at localhost/37459] ipc.NettyRpcServer(120): Bind to /172.31.2.10:34031 2023-09-12 20:59:27,257 INFO [Listener at localhost/37459] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-12 20:59:27,263 INFO [Listener at localhost/37459] mob.MobFileCache(124): MobFileCache disabled 2023-09-12 20:59:27,264 INFO [Listener at localhost/37459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 20:59:27,266 INFO [Listener at localhost/37459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 20:59:27,268 INFO [Listener at localhost/37459] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34031 connecting to ZooKeeper ensemble=127.0.0.1:58083 2023-09-12 20:59:27,273 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:340310x0, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-12 20:59:27,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34031-0x100a1e28c4e0001 connected 2023-09-12 20:59:27,274 DEBUG [Listener at localhost/37459] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-12 20:59:27,275 DEBUG [Listener at localhost/37459] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 20:59:27,276 DEBUG [Listener at localhost/37459] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-12 20:59:27,277 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34031 2023-09-12 20:59:27,277 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34031 2023-09-12 20:59:27,277 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34031 2023-09-12 20:59:27,278 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34031 2023-09-12 20:59:27,278 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34031 2023-09-12 20:59:27,291 INFO [Listener at localhost/37459] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-09-12 20:59:27,291 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 20:59:27,291 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-12 20:59:27,292 INFO [Listener at localhost/37459] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-12 20:59:27,292 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 20:59:27,292 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-12 20:59:27,292 INFO [Listener at localhost/37459] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-12 20:59:27,294 INFO [Listener at localhost/37459] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45939 2023-09-12 20:59:27,294 INFO [Listener at localhost/37459] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-12 20:59:27,296 INFO [Listener at localhost/37459] mob.MobFileCache(124): MobFileCache disabled 2023-09-12 20:59:27,297 INFO [Listener at localhost/37459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 20:59:27,298 INFO [Listener at localhost/37459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 20:59:27,301 INFO [Listener at localhost/37459] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45939 connecting to ZooKeeper ensemble=127.0.0.1:58083 2023-09-12 20:59:27,304 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:459390x0, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-12 20:59:27,305 DEBUG [Listener at localhost/37459] zookeeper.ZKUtil(164): regionserver:459390x0, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-12 20:59:27,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45939-0x100a1e28c4e0002 connected 2023-09-12 20:59:27,306 DEBUG [Listener at localhost/37459] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 20:59:27,307 DEBUG [Listener at localhost/37459] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-12 20:59:27,307 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45939 2023-09-12 20:59:27,308 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45939 2023-09-12 20:59:27,308 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45939 2023-09-12 20:59:27,312 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45939 2023-09-12 20:59:27,312 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45939 2023-09-12 20:59:27,323 INFO [Listener at localhost/37459] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-09-12 20:59:27,323 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 20:59:27,324 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-12 20:59:27,324 INFO [Listener at localhost/37459] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-12 20:59:27,324 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 20:59:27,324 INFO [Listener at localhost/37459] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-12 20:59:27,324 INFO [Listener at localhost/37459] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-12 20:59:27,325 INFO [Listener at localhost/37459] ipc.NettyRpcServer(120): Bind to /172.31.2.10:42813 2023-09-12 20:59:27,326 INFO [Listener at localhost/37459] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-12 20:59:27,326 INFO [Listener at localhost/37459] mob.MobFileCache(124): MobFileCache disabled 2023-09-12 20:59:27,327 INFO [Listener at localhost/37459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 20:59:27,329 INFO [Listener at localhost/37459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 20:59:27,331 INFO [Listener at localhost/37459] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42813 connecting to ZooKeeper ensemble=127.0.0.1:58083 2023-09-12 20:59:27,334 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:428130x0, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-12 20:59:27,336 DEBUG [Listener at localhost/37459] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-12 20:59:27,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42813-0x100a1e28c4e0003 connected 2023-09-12 20:59:27,336 DEBUG [Listener at localhost/37459] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 20:59:27,337 DEBUG [Listener at localhost/37459] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-12 20:59:27,340 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42813 2023-09-12 20:59:27,344 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42813 2023-09-12 20:59:27,344 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42813 2023-09-12 20:59:27,347 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42813 2023-09-12 20:59:27,348 DEBUG [Listener at localhost/37459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42813 2023-09-12 20:59:27,350 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,38453,1694552366017 2023-09-12 20:59:27,358 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-12 20:59:27,360 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,38453,1694552366017 2023-09-12 20:59:27,378 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-12 20:59:27,378 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-12 20:59:27,378 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-12 20:59:27,378 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-12 20:59:27,379 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 20:59:27,381 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-12 20:59:27,382 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,38453,1694552366017 from backup master directory 2023-09-12 20:59:27,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-12 20:59:27,386 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,38453,1694552366017 2023-09-12 20:59:27,386 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-12 20:59:27,387 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-12 20:59:27,387 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,38453,1694552366017 2023-09-12 20:59:27,390 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-12 20:59:27,391 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-12 20:59:27,493 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/hbase.id with ID: 1bbe8366-6035-43fa-a50c-fb29c38f6011 2023-09-12 20:59:27,535 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 20:59:27,550 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 20:59:27,599 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x03a086d1 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 20:59:27,631 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c26de3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 20:59:27,654 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-12 20:59:27,656 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-12 20:59:27,673 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-12 20:59:27,673 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-12 20:59:27,675 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-12 20:59:27,679 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-12 20:59:27,680 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-12 20:59:27,717 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/MasterData/data/master/store-tmp 2023-09-12 20:59:27,756 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:27,756 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-12 20:59:27,756 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 20:59:27,756 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 20:59:27,756 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-12 20:59:27,756 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 20:59:27,756 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 20:59:27,756 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-12 20:59:27,758 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/MasterData/WALs/jenkins-hbase9.apache.org,38453,1694552366017 2023-09-12 20:59:27,779 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C38453%2C1694552366017, suffix=, logDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/MasterData/WALs/jenkins-hbase9.apache.org,38453,1694552366017, archiveDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/MasterData/oldWALs, maxLogs=10 2023-09-12 20:59:27,836 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32979,DS-66e49a79-df22-4e77-9712-7d5d88c874d6,DISK] 2023-09-12 20:59:27,836 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43915,DS-f0ae895c-b4db-4260-973a-f32d8e09cf8b,DISK] 2023-09-12 20:59:27,836 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43517,DS-db87646e-7723-4482-a354-cd3f2414d22c,DISK] 2023-09-12 20:59:27,845 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-12 20:59:27,906 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/MasterData/WALs/jenkins-hbase9.apache.org,38453,1694552366017/jenkins-hbase9.apache.org%2C38453%2C1694552366017.1694552367790 2023-09-12 20:59:27,906 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32979,DS-66e49a79-df22-4e77-9712-7d5d88c874d6,DISK], DatanodeInfoWithStorage[127.0.0.1:43915,DS-f0ae895c-b4db-4260-973a-f32d8e09cf8b,DISK], DatanodeInfoWithStorage[127.0.0.1:43517,DS-db87646e-7723-4482-a354-cd3f2414d22c,DISK]] 2023-09-12 20:59:27,907 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-12 20:59:27,908 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:27,912 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-12 20:59:27,913 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-12 20:59:27,982 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-12 20:59:27,990 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-12 20:59:28,023 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-12 20:59:28,035 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 20:59:28,040 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-12 20:59:28,042 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-12 20:59:28,057 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-12 20:59:28,061 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 20:59:28,062 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60915754, jitterRate=-0.09228453040122986}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 20:59:28,062 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-12 20:59:28,063 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-12 20:59:28,084 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-12 20:59:28,084 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-12 20:59:28,086 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-12 20:59:28,088 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 0 msec 2023-09-12 20:59:28,123 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 34 msec 2023-09-12 20:59:28,123 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-12 20:59:28,150 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-12 20:59:28,155 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-12 20:59:28,178 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-12 20:59:28,183 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-12 20:59:28,184 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-12 20:59:28,190 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-12 20:59:28,193 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-12 20:59:28,197 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 20:59:28,198 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-12 20:59:28,199 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-12 20:59:28,212 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-12 20:59:28,216 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-12 20:59:28,217 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-12 20:59:28,217 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-12 20:59:28,217 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 20:59:28,217 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-12 20:59:28,217 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,38453,1694552366017, sessionid=0x100a1e28c4e0000, setting cluster-up flag (Was=false) 2023-09-12 20:59:28,233 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 20:59:28,239 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-12 20:59:28,241 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,38453,1694552366017 2023-09-12 20:59:28,251 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 20:59:28,256 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-12 20:59:28,257 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,38453,1694552366017 2023-09-12 20:59:28,260 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp 2023-09-12 20:59:28,353 INFO [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(951): ClusterId : 1bbe8366-6035-43fa-a50c-fb29c38f6011 2023-09-12 20:59:28,353 INFO [RS:2;jenkins-hbase9:42813] regionserver.HRegionServer(951): ClusterId : 1bbe8366-6035-43fa-a50c-fb29c38f6011 2023-09-12 20:59:28,353 INFO [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(951): ClusterId : 1bbe8366-6035-43fa-a50c-fb29c38f6011 2023-09-12 20:59:28,359 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-12 20:59:28,360 DEBUG [RS:0;jenkins-hbase9:34031] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-12 20:59:28,360 DEBUG [RS:1;jenkins-hbase9:45939] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-12 20:59:28,360 DEBUG [RS:2;jenkins-hbase9:42813] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-12 20:59:28,364 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 20:59:28,364 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-12 20:59:28,368 DEBUG [RS:2;jenkins-hbase9:42813] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-12 20:59:28,368 DEBUG [RS:0;jenkins-hbase9:34031] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-12 20:59:28,368 DEBUG [RS:1;jenkins-hbase9:45939] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-12 20:59:28,368 DEBUG [RS:0;jenkins-hbase9:34031] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-12 20:59:28,368 DEBUG [RS:2;jenkins-hbase9:42813] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-12 20:59:28,368 DEBUG [RS:1;jenkins-hbase9:45939] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-12 20:59:28,371 DEBUG [RS:2;jenkins-hbase9:42813] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-12 20:59:28,372 DEBUG [RS:1;jenkins-hbase9:45939] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-12 20:59:28,372 DEBUG [RS:0;jenkins-hbase9:34031] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-12 20:59:28,379 DEBUG [RS:2;jenkins-hbase9:42813] zookeeper.ReadOnlyZKClient(139): Connect 0x0d87e5ec to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 20:59:28,379 DEBUG [RS:0;jenkins-hbase9:34031] zookeeper.ReadOnlyZKClient(139): Connect 0x66a04709 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 20:59:28,380 DEBUG [RS:1;jenkins-hbase9:45939] zookeeper.ReadOnlyZKClient(139): Connect 0x7a7d8803 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 20:59:28,388 DEBUG [RS:0;jenkins-hbase9:34031] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6867a5ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 20:59:28,388 DEBUG [RS:2;jenkins-hbase9:42813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3401a2c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 20:59:28,389 DEBUG [RS:0;jenkins-hbase9:34031] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c582c79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-12 20:59:28,389 DEBUG [RS:2;jenkins-hbase9:42813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77f8e9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-12 20:59:28,419 DEBUG [RS:1;jenkins-hbase9:45939] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74ba793c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 20:59:28,420 DEBUG [RS:1;jenkins-hbase9:45939] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35877307, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-12 20:59:28,440 DEBUG [RS:0;jenkins-hbase9:34031] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:34031 2023-09-12 20:59:28,443 DEBUG [RS:2;jenkins-hbase9:42813] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:42813 2023-09-12 20:59:28,444 DEBUG [RS:1;jenkins-hbase9:45939] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:45939 2023-09-12 20:59:28,445 INFO [RS:0;jenkins-hbase9:34031] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-12 20:59:28,445 INFO [RS:0;jenkins-hbase9:34031] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-12 20:59:28,445 INFO [RS:1;jenkins-hbase9:45939] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-12 20:59:28,446 INFO [RS:1;jenkins-hbase9:45939] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-12 20:59:28,446 INFO [RS:2;jenkins-hbase9:42813] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-12 20:59:28,446 INFO [RS:2;jenkins-hbase9:42813] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-12 20:59:28,446 DEBUG [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-12 20:59:28,446 DEBUG [RS:2;jenkins-hbase9:42813] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-12 20:59:28,446 DEBUG [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-12 20:59:28,447 INFO [RS:1;jenkins-hbase9:45939] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 20:59:28,447 INFO [RS:0;jenkins-hbase9:34031] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 20:59:28,448 DEBUG [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(1022): About to register with Master. 2023-09-12 20:59:28,447 DEBUG [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(1022): About to register with Master. 2023-09-12 20:59:28,448 INFO [RS:2;jenkins-hbase9:42813] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 20:59:28,448 DEBUG [RS:2;jenkins-hbase9:42813] regionserver.HRegionServer(1022): About to register with Master. 2023-09-12 20:59:28,450 INFO [RS:2;jenkins-hbase9:42813] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,38453,1694552366017 with isa=jenkins-hbase9.apache.org/172.31.2.10:42813, startcode=1694552367323 2023-09-12 20:59:28,450 INFO [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,38453,1694552366017 with isa=jenkins-hbase9.apache.org/172.31.2.10:34031, startcode=1694552367245 2023-09-12 20:59:28,450 INFO [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,38453,1694552366017 with isa=jenkins-hbase9.apache.org/172.31.2.10:45939, startcode=1694552367290 2023-09-12 20:59:28,465 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-12 20:59:28,469 DEBUG [RS:1;jenkins-hbase9:45939] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-12 20:59:28,469 DEBUG [RS:2;jenkins-hbase9:42813] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-12 20:59:28,469 DEBUG [RS:0;jenkins-hbase9:34031] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-12 20:59:28,475 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-12 20:59:28,475 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-12 20:59:28,475 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-12 20:59:28,475 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-12 20:59:28,475 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-09-12 20:59:28,475 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,475 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-12 20:59:28,476 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,478 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1694552398478 2023-09-12 20:59:28,480 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-12 20:59:28,484 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-12 20:59:28,484 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-12 20:59:28,490 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-12 20:59:28,491 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-12 20:59:28,499 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-12 20:59:28,499 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-12 20:59:28,500 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-12 20:59:28,500 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-12 20:59:28,501 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,502 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-12 20:59:28,505 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-12 20:59:28,505 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-12 20:59:28,512 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-12 20:59:28,513 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-12 20:59:28,515 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1694552368515,5,FailOnTimeoutGroup] 2023-09-12 20:59:28,515 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1694552368515,5,FailOnTimeoutGroup] 2023-09-12 20:59:28,516 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,516 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-12 20:59:28,518 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,518 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,531 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60875, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-12 20:59:28,531 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57871, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-12 20:59:28,532 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55885, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-12 20:59:28,540 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-12 20:59:28,541 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-12 20:59:28,542 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 20:59:28,544 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38453] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:28,556 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38453] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:28,557 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38453] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:28,569 DEBUG [RS:2;jenkins-hbase9:42813] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 20:59:28,569 DEBUG [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 20:59:28,569 DEBUG [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 20:59:28,569 DEBUG [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38861 2023-09-12 20:59:28,569 DEBUG [RS:2;jenkins-hbase9:42813] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38861 2023-09-12 20:59:28,570 DEBUG [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-12 20:59:28,569 DEBUG [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38861 2023-09-12 20:59:28,570 DEBUG [RS:2;jenkins-hbase9:42813] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-12 20:59:28,570 DEBUG [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-12 20:59:28,571 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:28,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-12 20:59:28,577 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 20:59:28,578 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/info 2023-09-12 20:59:28,579 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-12 20:59:28,580 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 20:59:28,580 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-12 20:59:28,583 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/rep_barrier 2023-09-12 20:59:28,583 DEBUG [RS:2;jenkins-hbase9:42813] zookeeper.ZKUtil(162): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:28,583 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,45939,1694552367290] 2023-09-12 20:59:28,583 WARN [RS:2;jenkins-hbase9:42813] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-12 20:59:28,583 DEBUG [RS:0;jenkins-hbase9:34031] zookeeper.ZKUtil(162): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:28,583 INFO [RS:2;jenkins-hbase9:42813] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-12 20:59:28,583 WARN [RS:0;jenkins-hbase9:34031] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-12 20:59:28,584 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-12 20:59:28,583 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,42813,1694552367323] 2023-09-12 20:59:28,584 INFO [RS:0;jenkins-hbase9:34031] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-12 20:59:28,584 DEBUG [RS:2;jenkins-hbase9:42813] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/WALs/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:28,585 DEBUG [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/WALs/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:28,585 DEBUG [RS:1;jenkins-hbase9:45939] zookeeper.ZKUtil(162): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:28,584 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,34031,1694552367245] 2023-09-12 20:59:28,585 WARN [RS:1;jenkins-hbase9:45939] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-12 20:59:28,585 INFO [RS:1;jenkins-hbase9:45939] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-12 20:59:28,585 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 20:59:28,586 DEBUG [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/WALs/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:28,586 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-12 20:59:28,595 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/table 2023-09-12 20:59:28,596 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-12 20:59:28,598 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 20:59:28,600 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740 2023-09-12 20:59:28,601 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740 2023-09-12 20:59:28,602 DEBUG [RS:1;jenkins-hbase9:45939] zookeeper.ZKUtil(162): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:28,603 DEBUG [RS:1;jenkins-hbase9:45939] zookeeper.ZKUtil(162): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:28,603 DEBUG [RS:0;jenkins-hbase9:34031] zookeeper.ZKUtil(162): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:28,604 DEBUG [RS:2;jenkins-hbase9:42813] zookeeper.ZKUtil(162): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:28,604 DEBUG [RS:0;jenkins-hbase9:34031] zookeeper.ZKUtil(162): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:28,604 DEBUG [RS:0;jenkins-hbase9:34031] zookeeper.ZKUtil(162): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:28,604 DEBUG [RS:2;jenkins-hbase9:42813] zookeeper.ZKUtil(162): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:28,605 DEBUG [RS:2;jenkins-hbase9:42813] zookeeper.ZKUtil(162): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:28,608 DEBUG [RS:1;jenkins-hbase9:45939] zookeeper.ZKUtil(162): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:28,614 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-12 20:59:28,617 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-12 20:59:28,621 DEBUG [RS:2;jenkins-hbase9:42813] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-12 20:59:28,621 DEBUG [RS:0;jenkins-hbase9:34031] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-12 20:59:28,627 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 20:59:28,621 DEBUG [RS:1;jenkins-hbase9:45939] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-12 20:59:28,629 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73584236, jitterRate=0.09649056196212769}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-12 20:59:28,629 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-12 20:59:28,629 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-12 20:59:28,629 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-12 20:59:28,629 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-12 20:59:28,629 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-12 20:59:28,629 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-12 20:59:28,632 INFO [RS:2;jenkins-hbase9:42813] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-12 20:59:28,633 INFO [RS:0;jenkins-hbase9:34031] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-12 20:59:28,632 INFO [RS:1;jenkins-hbase9:45939] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-12 20:59:28,634 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-12 20:59:28,634 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-12 20:59:28,640 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-12 20:59:28,640 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-12 20:59:28,651 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-12 20:59:28,656 INFO [RS:1;jenkins-hbase9:45939] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-12 20:59:28,656 INFO [RS:2;jenkins-hbase9:42813] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-12 20:59:28,657 INFO [RS:0;jenkins-hbase9:34031] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-12 20:59:28,661 INFO [RS:2;jenkins-hbase9:42813] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-12 20:59:28,662 INFO [RS:2;jenkins-hbase9:42813] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,661 INFO [RS:0;jenkins-hbase9:34031] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-12 20:59:28,661 INFO [RS:1;jenkins-hbase9:45939] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-12 20:59:28,663 INFO [RS:2;jenkins-hbase9:42813] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-12 20:59:28,662 INFO [RS:0;jenkins-hbase9:34031] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,663 INFO [RS:1;jenkins-hbase9:45939] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,663 INFO [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-12 20:59:28,664 INFO [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-12 20:59:28,668 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-12 20:59:28,671 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-12 20:59:28,674 INFO [RS:0;jenkins-hbase9:34031] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,674 INFO [RS:1;jenkins-hbase9:45939] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,674 INFO [RS:2;jenkins-hbase9:42813] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,674 DEBUG [RS:0;jenkins-hbase9:34031] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,674 DEBUG [RS:1;jenkins-hbase9:45939] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,674 DEBUG [RS:0;jenkins-hbase9:34031] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,674 DEBUG [RS:2;jenkins-hbase9:42813] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,675 DEBUG [RS:0;jenkins-hbase9:34031] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,675 DEBUG [RS:1;jenkins-hbase9:45939] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,675 DEBUG [RS:0;jenkins-hbase9:34031] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,675 DEBUG [RS:2;jenkins-hbase9:42813] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,675 DEBUG [RS:0;jenkins-hbase9:34031] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,675 DEBUG [RS:2;jenkins-hbase9:42813] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,675 DEBUG [RS:0;jenkins-hbase9:34031] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-12 20:59:28,675 DEBUG [RS:2;jenkins-hbase9:42813] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,675 DEBUG [RS:0;jenkins-hbase9:34031] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,675 DEBUG [RS:2;jenkins-hbase9:42813] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,675 DEBUG [RS:0;jenkins-hbase9:34031] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,675 DEBUG [RS:2;jenkins-hbase9:42813] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-12 20:59:28,676 DEBUG [RS:0;jenkins-hbase9:34031] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,676 DEBUG [RS:2;jenkins-hbase9:42813] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,676 DEBUG [RS:0;jenkins-hbase9:34031] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,676 DEBUG [RS:2;jenkins-hbase9:42813] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,675 DEBUG [RS:1;jenkins-hbase9:45939] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,676 DEBUG [RS:2;jenkins-hbase9:42813] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,676 DEBUG [RS:1;jenkins-hbase9:45939] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,676 DEBUG [RS:2;jenkins-hbase9:42813] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,677 DEBUG [RS:1;jenkins-hbase9:45939] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,677 DEBUG [RS:1;jenkins-hbase9:45939] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-12 20:59:28,677 DEBUG [RS:1;jenkins-hbase9:45939] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,677 DEBUG [RS:1;jenkins-hbase9:45939] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,677 DEBUG [RS:1;jenkins-hbase9:45939] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,677 DEBUG [RS:1;jenkins-hbase9:45939] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-12 20:59:28,681 INFO [RS:2;jenkins-hbase9:42813] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,681 INFO [RS:0;jenkins-hbase9:34031] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,681 INFO [RS:2;jenkins-hbase9:42813] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,681 INFO [RS:0;jenkins-hbase9:34031] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,681 INFO [RS:1;jenkins-hbase9:45939] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,681 INFO [RS:0;jenkins-hbase9:34031] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,681 INFO [RS:2;jenkins-hbase9:42813] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,681 INFO [RS:1;jenkins-hbase9:45939] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,682 INFO [RS:1;jenkins-hbase9:45939] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,697 INFO [RS:1;jenkins-hbase9:45939] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-12 20:59:28,698 INFO [RS:2;jenkins-hbase9:42813] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-12 20:59:28,698 INFO [RS:0;jenkins-hbase9:34031] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-12 20:59:28,700 INFO [RS:2;jenkins-hbase9:42813] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42813,1694552367323-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,700 INFO [RS:1;jenkins-hbase9:45939] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45939,1694552367290-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,700 INFO [RS:0;jenkins-hbase9:34031] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34031,1694552367245-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:28,720 INFO [RS:2;jenkins-hbase9:42813] regionserver.Replication(203): jenkins-hbase9.apache.org,42813,1694552367323 started 2023-09-12 20:59:28,720 INFO [RS:2;jenkins-hbase9:42813] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,42813,1694552367323, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:42813, sessionid=0x100a1e28c4e0003 2023-09-12 20:59:28,720 DEBUG [RS:2;jenkins-hbase9:42813] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-12 20:59:28,720 DEBUG [RS:2;jenkins-hbase9:42813] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:28,720 DEBUG [RS:2;jenkins-hbase9:42813] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,42813,1694552367323' 2023-09-12 20:59:28,720 DEBUG [RS:2;jenkins-hbase9:42813] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-12 20:59:28,721 DEBUG [RS:2;jenkins-hbase9:42813] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-12 20:59:28,721 DEBUG [RS:2;jenkins-hbase9:42813] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-12 20:59:28,722 DEBUG [RS:2;jenkins-hbase9:42813] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-12 20:59:28,722 DEBUG [RS:2;jenkins-hbase9:42813] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:28,722 DEBUG [RS:2;jenkins-hbase9:42813] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,42813,1694552367323' 2023-09-12 20:59:28,722 DEBUG [RS:2;jenkins-hbase9:42813] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:28,722 DEBUG [RS:2;jenkins-hbase9:42813] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:28,723 INFO [RS:1;jenkins-hbase9:45939] regionserver.Replication(203): jenkins-hbase9.apache.org,45939,1694552367290 started 2023-09-12 20:59:28,723 INFO [RS:0;jenkins-hbase9:34031] regionserver.Replication(203): jenkins-hbase9.apache.org,34031,1694552367245 started 2023-09-12 20:59:28,723 DEBUG [RS:2;jenkins-hbase9:42813] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-12 20:59:28,723 INFO [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,45939,1694552367290, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:45939, sessionid=0x100a1e28c4e0002 2023-09-12 20:59:28,723 INFO [RS:2;jenkins-hbase9:42813] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-12 20:59:28,723 INFO [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,34031,1694552367245, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:34031, sessionid=0x100a1e28c4e0001 2023-09-12 20:59:28,723 INFO [RS:2;jenkins-hbase9:42813] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-12 20:59:28,723 DEBUG [RS:1;jenkins-hbase9:45939] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-12 20:59:28,723 DEBUG [RS:0;jenkins-hbase9:34031] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-12 20:59:28,723 DEBUG [RS:1;jenkins-hbase9:45939] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:28,724 DEBUG [RS:0;jenkins-hbase9:34031] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:28,725 DEBUG [RS:0;jenkins-hbase9:34031] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,34031,1694552367245' 2023-09-12 20:59:28,725 DEBUG [RS:0;jenkins-hbase9:34031] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-12 20:59:28,724 DEBUG [RS:1;jenkins-hbase9:45939] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45939,1694552367290' 2023-09-12 20:59:28,725 DEBUG [RS:1;jenkins-hbase9:45939] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-12 20:59:28,725 DEBUG [RS:0;jenkins-hbase9:34031] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-12 20:59:28,726 DEBUG [RS:1;jenkins-hbase9:45939] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-12 20:59:28,726 DEBUG [RS:0;jenkins-hbase9:34031] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-12 20:59:28,726 DEBUG [RS:0;jenkins-hbase9:34031] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-12 20:59:28,726 DEBUG [RS:1;jenkins-hbase9:45939] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-12 20:59:28,726 DEBUG [RS:0;jenkins-hbase9:34031] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:28,727 DEBUG [RS:0;jenkins-hbase9:34031] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,34031,1694552367245' 2023-09-12 20:59:28,727 DEBUG [RS:0;jenkins-hbase9:34031] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:28,727 DEBUG [RS:1;jenkins-hbase9:45939] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-12 20:59:28,727 DEBUG [RS:1;jenkins-hbase9:45939] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:28,727 DEBUG [RS:1;jenkins-hbase9:45939] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45939,1694552367290' 2023-09-12 20:59:28,727 DEBUG [RS:1;jenkins-hbase9:45939] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:28,727 DEBUG [RS:0;jenkins-hbase9:34031] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:28,728 DEBUG [RS:1;jenkins-hbase9:45939] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:28,728 DEBUG [RS:0;jenkins-hbase9:34031] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-12 20:59:28,728 INFO [RS:0;jenkins-hbase9:34031] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-12 20:59:28,729 INFO [RS:0;jenkins-hbase9:34031] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-12 20:59:28,729 DEBUG [RS:1;jenkins-hbase9:45939] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-12 20:59:28,729 INFO [RS:1;jenkins-hbase9:45939] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-12 20:59:28,729 INFO [RS:1;jenkins-hbase9:45939] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-12 20:59:28,824 DEBUG [jenkins-hbase9:38453] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-12 20:59:28,828 DEBUG [jenkins-hbase9:38453] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-12 20:59:28,834 INFO [RS:1;jenkins-hbase9:45939] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45939%2C1694552367290, suffix=, logDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/WALs/jenkins-hbase9.apache.org,45939,1694552367290, archiveDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/oldWALs, maxLogs=32 2023-09-12 20:59:28,834 INFO [RS:2;jenkins-hbase9:42813] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C42813%2C1694552367323, suffix=, logDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/WALs/jenkins-hbase9.apache.org,42813,1694552367323, archiveDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/oldWALs, maxLogs=32 2023-09-12 20:59:28,835 INFO [RS:0;jenkins-hbase9:34031] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C34031%2C1694552367245, suffix=, logDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/WALs/jenkins-hbase9.apache.org,34031,1694552367245, archiveDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/oldWALs, maxLogs=32 2023-09-12 20:59:28,835 DEBUG [jenkins-hbase9:38453] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 20:59:28,835 DEBUG [jenkins-hbase9:38453] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 20:59:28,835 DEBUG [jenkins-hbase9:38453] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 20:59:28,835 DEBUG [jenkins-hbase9:38453] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 20:59:28,838 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,34031,1694552367245, state=OPENING 2023-09-12 20:59:28,847 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-12 20:59:28,849 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 20:59:28,850 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-12 20:59:28,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,34031,1694552367245}] 2023-09-12 20:59:28,866 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43915,DS-f0ae895c-b4db-4260-973a-f32d8e09cf8b,DISK] 2023-09-12 20:59:28,867 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43517,DS-db87646e-7723-4482-a354-cd3f2414d22c,DISK] 2023-09-12 20:59:28,868 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43517,DS-db87646e-7723-4482-a354-cd3f2414d22c,DISK] 2023-09-12 20:59:28,879 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43915,DS-f0ae895c-b4db-4260-973a-f32d8e09cf8b,DISK] 2023-09-12 20:59:28,880 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32979,DS-66e49a79-df22-4e77-9712-7d5d88c874d6,DISK] 2023-09-12 20:59:28,880 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43517,DS-db87646e-7723-4482-a354-cd3f2414d22c,DISK] 2023-09-12 20:59:28,880 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43915,DS-f0ae895c-b4db-4260-973a-f32d8e09cf8b,DISK] 2023-09-12 20:59:28,880 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32979,DS-66e49a79-df22-4e77-9712-7d5d88c874d6,DISK] 2023-09-12 20:59:28,881 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32979,DS-66e49a79-df22-4e77-9712-7d5d88c874d6,DISK] 2023-09-12 20:59:28,898 INFO [RS:0;jenkins-hbase9:34031] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/WALs/jenkins-hbase9.apache.org,34031,1694552367245/jenkins-hbase9.apache.org%2C34031%2C1694552367245.1694552368842 2023-09-12 20:59:28,898 INFO [RS:1;jenkins-hbase9:45939] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/WALs/jenkins-hbase9.apache.org,45939,1694552367290/jenkins-hbase9.apache.org%2C45939%2C1694552367290.1694552368841 2023-09-12 20:59:28,898 INFO [RS:2;jenkins-hbase9:42813] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/WALs/jenkins-hbase9.apache.org,42813,1694552367323/jenkins-hbase9.apache.org%2C42813%2C1694552367323.1694552368841 2023-09-12 20:59:28,899 DEBUG [RS:0;jenkins-hbase9:34031] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43915,DS-f0ae895c-b4db-4260-973a-f32d8e09cf8b,DISK], DatanodeInfoWithStorage[127.0.0.1:32979,DS-66e49a79-df22-4e77-9712-7d5d88c874d6,DISK], DatanodeInfoWithStorage[127.0.0.1:43517,DS-db87646e-7723-4482-a354-cd3f2414d22c,DISK]] 2023-09-12 20:59:28,900 DEBUG [RS:2;jenkins-hbase9:42813] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43517,DS-db87646e-7723-4482-a354-cd3f2414d22c,DISK], DatanodeInfoWithStorage[127.0.0.1:32979,DS-66e49a79-df22-4e77-9712-7d5d88c874d6,DISK], DatanodeInfoWithStorage[127.0.0.1:43915,DS-f0ae895c-b4db-4260-973a-f32d8e09cf8b,DISK]] 2023-09-12 20:59:28,908 DEBUG [RS:1;jenkins-hbase9:45939] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43517,DS-db87646e-7723-4482-a354-cd3f2414d22c,DISK], DatanodeInfoWithStorage[127.0.0.1:43915,DS-f0ae895c-b4db-4260-973a-f32d8e09cf8b,DISK], DatanodeInfoWithStorage[127.0.0.1:32979,DS-66e49a79-df22-4e77-9712-7d5d88c874d6,DISK]] 2023-09-12 20:59:29,073 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:29,075 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-12 20:59:29,078 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-12 20:59:29,092 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-12 20:59:29,093 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-12 20:59:29,096 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C34031%2C1694552367245.meta, suffix=.meta, logDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/WALs/jenkins-hbase9.apache.org,34031,1694552367245, archiveDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/oldWALs, maxLogs=32 2023-09-12 20:59:29,116 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43517,DS-db87646e-7723-4482-a354-cd3f2414d22c,DISK] 2023-09-12 20:59:29,118 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32979,DS-66e49a79-df22-4e77-9712-7d5d88c874d6,DISK] 2023-09-12 20:59:29,128 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43915,DS-f0ae895c-b4db-4260-973a-f32d8e09cf8b,DISK] 2023-09-12 20:59:29,134 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/WALs/jenkins-hbase9.apache.org,34031,1694552367245/jenkins-hbase9.apache.org%2C34031%2C1694552367245.meta.1694552369097.meta 2023-09-12 20:59:29,134 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43517,DS-db87646e-7723-4482-a354-cd3f2414d22c,DISK], DatanodeInfoWithStorage[127.0.0.1:32979,DS-66e49a79-df22-4e77-9712-7d5d88c874d6,DISK], DatanodeInfoWithStorage[127.0.0.1:43915,DS-f0ae895c-b4db-4260-973a-f32d8e09cf8b,DISK]] 2023-09-12 20:59:29,135 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-12 20:59:29,136 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-12 20:59:29,138 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 20:59:29,138 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-12 20:59:29,140 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-12 20:59:29,142 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-12 20:59:29,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-12 20:59:29,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:29,155 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-12 20:59:29,155 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-12 20:59:29,158 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-12 20:59:29,161 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/info 2023-09-12 20:59:29,162 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/info 2023-09-12 20:59:29,162 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-12 20:59:29,163 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 20:59:29,163 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-12 20:59:29,165 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/rep_barrier 2023-09-12 20:59:29,165 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/rep_barrier 2023-09-12 20:59:29,165 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-12 20:59:29,166 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 20:59:29,166 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-12 20:59:29,168 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/table 2023-09-12 20:59:29,168 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/table 2023-09-12 20:59:29,168 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-12 20:59:29,169 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 20:59:29,171 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740 2023-09-12 20:59:29,173 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740 2023-09-12 20:59:29,177 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-12 20:59:29,180 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-12 20:59:29,181 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64955684, jitterRate=-0.032084882259368896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-12 20:59:29,183 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-12 20:59:29,195 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1694552369064 2023-09-12 20:59:29,212 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-12 20:59:29,213 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-12 20:59:29,214 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,34031,1694552367245, state=OPEN 2023-09-12 20:59:29,216 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-12 20:59:29,216 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-12 20:59:29,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-12 20:59:29,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,34031,1694552367245 in 359 msec 2023-09-12 20:59:29,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-12 20:59:29,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 571 msec 2023-09-12 20:59:29,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 856 msec 2023-09-12 20:59:29,234 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1694552369234, completionTime=-1 2023-09-12 20:59:29,235 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-12 20:59:29,235 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-12 20:59:29,297 DEBUG [hconnection-0x69eed78f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:29,300 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:29,319 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-12 20:59:29,319 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1694552429319 2023-09-12 20:59:29,319 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1694552489319 2023-09-12 20:59:29,319 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 84 msec 2023-09-12 20:59:29,352 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38453,1694552366017-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:29,352 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38453,1694552366017-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:29,352 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38453,1694552366017-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:29,354 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:38453, period=300000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:29,354 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-12 20:59:29,361 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-12 20:59:29,369 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-12 20:59:29,371 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-12 20:59:29,380 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-12 20:59:29,382 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 20:59:29,385 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 20:59:29,406 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/hbase/namespace/ce2b7366128e33822ca30f39c1a504ce 2023-09-12 20:59:29,409 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/hbase/namespace/ce2b7366128e33822ca30f39c1a504ce empty. 2023-09-12 20:59:29,409 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/hbase/namespace/ce2b7366128e33822ca30f39c1a504ce 2023-09-12 20:59:29,409 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-12 20:59:29,450 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-12 20:59:29,452 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => ce2b7366128e33822ca30f39c1a504ce, NAME => 'hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 20:59:29,469 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:29,470 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing ce2b7366128e33822ca30f39c1a504ce, disabling compactions & flushes 2023-09-12 20:59:29,470 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. 2023-09-12 20:59:29,470 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. 2023-09-12 20:59:29,470 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. after waiting 0 ms 2023-09-12 20:59:29,470 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. 2023-09-12 20:59:29,470 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. 2023-09-12 20:59:29,470 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for ce2b7366128e33822ca30f39c1a504ce: 2023-09-12 20:59:29,474 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 20:59:29,489 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694552369477"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552369477"}]},"ts":"1694552369477"} 2023-09-12 20:59:29,515 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-12 20:59:29,517 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 20:59:29,521 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552369517"}]},"ts":"1694552369517"} 2023-09-12 20:59:29,526 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-12 20:59:29,530 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-12 20:59:29,532 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 20:59:29,532 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 20:59:29,532 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 20:59:29,532 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 20:59:29,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ce2b7366128e33822ca30f39c1a504ce, ASSIGN}] 2023-09-12 20:59:29,537 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ce2b7366128e33822ca30f39c1a504ce, ASSIGN 2023-09-12 20:59:29,539 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ce2b7366128e33822ca30f39c1a504ce, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34031,1694552367245; forceNewPlan=false, retain=false 2023-09-12 20:59:29,691 INFO [jenkins-hbase9:38453] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-12 20:59:29,692 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ce2b7366128e33822ca30f39c1a504ce, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:29,693 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694552369692"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552369692"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552369692"}]},"ts":"1694552369692"} 2023-09-12 20:59:29,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ce2b7366128e33822ca30f39c1a504ce, server=jenkins-hbase9.apache.org,34031,1694552367245}] 2023-09-12 20:59:29,860 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. 2023-09-12 20:59:29,860 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce2b7366128e33822ca30f39c1a504ce, NAME => 'hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce.', STARTKEY => '', ENDKEY => ''} 2023-09-12 20:59:29,860 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. service=AccessControlService 2023-09-12 20:59:29,861 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 20:59:29,862 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ce2b7366128e33822ca30f39c1a504ce 2023-09-12 20:59:29,862 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:29,862 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ce2b7366128e33822ca30f39c1a504ce 2023-09-12 20:59:29,862 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ce2b7366128e33822ca30f39c1a504ce 2023-09-12 20:59:29,864 INFO [StoreOpener-ce2b7366128e33822ca30f39c1a504ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ce2b7366128e33822ca30f39c1a504ce 2023-09-12 20:59:29,866 DEBUG [StoreOpener-ce2b7366128e33822ca30f39c1a504ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/namespace/ce2b7366128e33822ca30f39c1a504ce/info 2023-09-12 20:59:29,866 DEBUG [StoreOpener-ce2b7366128e33822ca30f39c1a504ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/namespace/ce2b7366128e33822ca30f39c1a504ce/info 2023-09-12 20:59:29,867 INFO [StoreOpener-ce2b7366128e33822ca30f39c1a504ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce2b7366128e33822ca30f39c1a504ce columnFamilyName info 2023-09-12 20:59:29,868 INFO [StoreOpener-ce2b7366128e33822ca30f39c1a504ce-1] regionserver.HStore(310): Store=ce2b7366128e33822ca30f39c1a504ce/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 20:59:29,870 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/namespace/ce2b7366128e33822ca30f39c1a504ce 2023-09-12 20:59:29,871 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/namespace/ce2b7366128e33822ca30f39c1a504ce 2023-09-12 20:59:29,875 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ce2b7366128e33822ca30f39c1a504ce 2023-09-12 20:59:29,879 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/namespace/ce2b7366128e33822ca30f39c1a504ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 20:59:29,880 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ce2b7366128e33822ca30f39c1a504ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71021205, jitterRate=0.05829842388629913}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 20:59:29,880 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ce2b7366128e33822ca30f39c1a504ce: 2023-09-12 20:59:29,883 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce., pid=6, masterSystemTime=1694552369852 2023-09-12 20:59:29,886 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. 2023-09-12 20:59:29,886 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. 2023-09-12 20:59:29,888 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ce2b7366128e33822ca30f39c1a504ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:29,888 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694552369887"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552369887"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552369887"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552369887"}]},"ts":"1694552369887"} 2023-09-12 20:59:29,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-12 20:59:29,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ce2b7366128e33822ca30f39c1a504ce, server=jenkins-hbase9.apache.org,34031,1694552367245 in 195 msec 2023-09-12 20:59:29,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-12 20:59:29,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ce2b7366128e33822ca30f39c1a504ce, ASSIGN in 361 msec 2023-09-12 20:59:29,901 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 20:59:29,901 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552369901"}]},"ts":"1694552369901"} 2023-09-12 20:59:29,904 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-12 20:59:29,908 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 20:59:29,911 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 537 msec 2023-09-12 20:59:29,982 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-12 20:59:29,984 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-12 20:59:29,984 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 20:59:30,021 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-12 20:59:30,036 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-12 20:59:30,042 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2023-09-12 20:59:30,054 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-12 20:59:30,066 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-12 20:59:30,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-09-12 20:59:30,080 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-12 20:59:30,084 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-12 20:59:30,084 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.697sec 2023-09-12 20:59:30,088 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-12 20:59:30,089 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-12 20:59:30,089 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-12 20:59:30,091 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38453,1694552366017-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-12 20:59:30,091 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38453,1694552366017-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-12 20:59:30,111 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-12 20:59:30,113 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-12 20:59:30,115 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 20:59:30,116 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 20:59:30,119 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/hbase/acl/b9e82d56b3db915c6632d50a60750688 2023-09-12 20:59:30,119 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-12 20:59:30,120 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/hbase/acl/b9e82d56b3db915c6632d50a60750688 empty. 2023-09-12 20:59:30,122 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/hbase/acl/b9e82d56b3db915c6632d50a60750688 2023-09-12 20:59:30,122 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-12 20:59:30,126 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-12 20:59:30,144 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-12 20:59:30,146 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => b9e82d56b3db915c6632d50a60750688, NAME => 'hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 20:59:30,158 DEBUG [Listener at localhost/37459] zookeeper.ReadOnlyZKClient(139): Connect 0x7d2f3867 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 20:59:30,167 DEBUG [Listener at localhost/37459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4170740d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 20:59:30,173 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:30,174 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing b9e82d56b3db915c6632d50a60750688, disabling compactions & flushes 2023-09-12 20:59:30,174 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. 2023-09-12 20:59:30,174 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. 2023-09-12 20:59:30,174 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. after waiting 0 ms 2023-09-12 20:59:30,174 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. 2023-09-12 20:59:30,174 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. 2023-09-12 20:59:30,174 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for b9e82d56b3db915c6632d50a60750688: 2023-09-12 20:59:30,180 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 20:59:30,182 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694552370182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552370182"}]},"ts":"1694552370182"} 2023-09-12 20:59:30,184 DEBUG [hconnection-0x6ce6cf7c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:30,185 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-12 20:59:30,186 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 20:59:30,186 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552370186"}]},"ts":"1694552370186"} 2023-09-12 20:59:30,189 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-12 20:59:30,195 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-12 20:59:30,196 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 20:59:30,196 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:30,196 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 20:59:30,196 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 20:59:30,196 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 20:59:30,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=b9e82d56b3db915c6632d50a60750688, ASSIGN}] 2023-09-12 20:59:30,199 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=b9e82d56b3db915c6632d50a60750688, ASSIGN 2023-09-12 20:59:30,199 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,38453,1694552366017 2023-09-12 20:59:30,199 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-12 20:59:30,199 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/test.cache.data in system properties and HBase conf 2023-09-12 20:59:30,199 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop.tmp.dir in system properties and HBase conf 2023-09-12 20:59:30,200 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop.log.dir in system properties and HBase conf 2023-09-12 20:59:30,200 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-12 20:59:30,200 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-12 20:59:30,200 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-12 20:59:30,200 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-12 20:59:30,200 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=b9e82d56b3db915c6632d50a60750688, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45939,1694552367290; forceNewPlan=false, retain=false 2023-09-12 20:59:30,200 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-12 20:59:30,200 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-12 20:59:30,201 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-12 20:59:30,201 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-12 20:59:30,201 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-12 20:59:30,201 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-12 20:59:30,201 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-12 20:59:30,201 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-12 20:59:30,201 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/nfs.dump.dir in system properties and HBase conf 2023-09-12 20:59:30,201 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/java.io.tmpdir in system properties and HBase conf 2023-09-12 20:59:30,201 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-12 20:59:30,202 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-12 20:59:30,202 INFO [Listener at localhost/37459] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-12 20:59:30,230 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-12 20:59:30,350 INFO [jenkins-hbase9:38453] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-12 20:59:30,352 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b9e82d56b3db915c6632d50a60750688, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:30,352 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694552370352"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552370352"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552370352"}]},"ts":"1694552370352"} 2023-09-12 20:59:30,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure b9e82d56b3db915c6632d50a60750688, server=jenkins-hbase9.apache.org,45939,1694552367290}] 2023-09-12 20:59:30,431 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-12 20:59:30,510 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:30,511 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-12 20:59:30,514 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-12 20:59:30,520 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. 2023-09-12 20:59:30,521 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b9e82d56b3db915c6632d50a60750688, NAME => 'hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688.', STARTKEY => '', ENDKEY => ''} 2023-09-12 20:59:30,521 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. service=AccessControlService 2023-09-12 20:59:30,522 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 20:59:30,522 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl b9e82d56b3db915c6632d50a60750688 2023-09-12 20:59:30,522 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:30,522 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for b9e82d56b3db915c6632d50a60750688 2023-09-12 20:59:30,522 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for b9e82d56b3db915c6632d50a60750688 2023-09-12 20:59:30,524 INFO [StoreOpener-b9e82d56b3db915c6632d50a60750688-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region b9e82d56b3db915c6632d50a60750688 2023-09-12 20:59:30,527 DEBUG [StoreOpener-b9e82d56b3db915c6632d50a60750688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/acl/b9e82d56b3db915c6632d50a60750688/l 2023-09-12 20:59:30,527 DEBUG [StoreOpener-b9e82d56b3db915c6632d50a60750688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/acl/b9e82d56b3db915c6632d50a60750688/l 2023-09-12 20:59:30,528 INFO [StoreOpener-b9e82d56b3db915c6632d50a60750688-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9e82d56b3db915c6632d50a60750688 columnFamilyName l 2023-09-12 20:59:30,529 INFO [StoreOpener-b9e82d56b3db915c6632d50a60750688-1] regionserver.HStore(310): Store=b9e82d56b3db915c6632d50a60750688/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 20:59:30,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/acl/b9e82d56b3db915c6632d50a60750688 2023-09-12 20:59:30,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/acl/b9e82d56b3db915c6632d50a60750688 2023-09-12 20:59:30,538 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for b9e82d56b3db915c6632d50a60750688 2023-09-12 20:59:30,542 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/acl/b9e82d56b3db915c6632d50a60750688/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 20:59:30,543 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened b9e82d56b3db915c6632d50a60750688; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70322839, jitterRate=0.04789195954799652}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 20:59:30,543 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for b9e82d56b3db915c6632d50a60750688: 2023-09-12 20:59:30,546 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688., pid=11, masterSystemTime=1694552370510 2023-09-12 20:59:30,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. 2023-09-12 20:59:30,550 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. 2023-09-12 20:59:30,551 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b9e82d56b3db915c6632d50a60750688, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:30,552 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694552370551"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552370551"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552370551"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552370551"}]},"ts":"1694552370551"} 2023-09-12 20:59:30,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-12 20:59:30,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure b9e82d56b3db915c6632d50a60750688, server=jenkins-hbase9.apache.org,45939,1694552367290 in 199 msec 2023-09-12 20:59:30,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-12 20:59:30,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=b9e82d56b3db915c6632d50a60750688, ASSIGN in 381 msec 2023-09-12 20:59:30,583 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 20:59:30,583 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552370583"}]},"ts":"1694552370583"} 2023-09-12 20:59:30,585 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-12 20:59:30,588 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 20:59:30,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 477 msec 2023-09-12 20:59:30,731 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-12 20:59:30,732 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-12 20:59:30,740 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-12 20:59:31,447 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 20:59:31,777 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 20:59:31,783 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_39781_jobhistory____8v7u4u/webapp 2023-09-12 20:59:31,952 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-12 20:59:31,952 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-12 20:59:31,952 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-12 20:59:31,956 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-12 20:59:32,034 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 20:59:32,342 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 20:59:32,602 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-12 20:59:32,631 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:39781 2023-09-12 20:59:32,941 WARN [Listener at jenkins-hbase9.apache.org/45801] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 20:59:33,185 WARN [Listener at jenkins-hbase9.apache.org/45801] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-12 20:59:33,186 INFO [Listener at jenkins-hbase9.apache.org/45801] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 20:59:33,196 INFO [Listener at jenkins-hbase9.apache.org/45801] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_46501_cluster____.7zddvv/webapp 2023-09-12 20:59:33,275 INFO [Listener at jenkins-hbase9.apache.org/45801] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-12 20:59:33,275 INFO [Listener at jenkins-hbase9.apache.org/45801] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-12 20:59:33,275 INFO [Listener at jenkins-hbase9.apache.org/45801] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-12 20:59:33,275 INFO [Listener at jenkins-hbase9.apache.org/45801] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-12 20:59:33,284 INFO [Listener at jenkins-hbase9.apache.org/45801] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 20:59:33,474 INFO [Listener at jenkins-hbase9.apache.org/45801] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 20:59:33,599 INFO [Listener at jenkins-hbase9.apache.org/45801] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 20:59:33,608 INFO [Listener at jenkins-hbase9.apache.org/45801] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:46501 2023-09-12 20:59:34,053 WARN [Listener at jenkins-hbase9.apache.org/39559] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 20:59:34,078 WARN [Listener at jenkins-hbase9.apache.org/39559] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-12 20:59:34,078 INFO [Listener at jenkins-hbase9.apache.org/39559] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 20:59:34,085 INFO [Listener at jenkins-hbase9.apache.org/39559] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_32799_node____.ll4imn/webapp 2023-09-12 20:59:34,135 INFO [Listener at jenkins-hbase9.apache.org/39559] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-12 20:59:34,135 INFO [Listener at jenkins-hbase9.apache.org/39559] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-12 20:59:34,136 INFO [Listener at jenkins-hbase9.apache.org/39559] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-12 20:59:34,136 INFO [Listener at jenkins-hbase9.apache.org/39559] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-12 20:59:34,144 INFO [Listener at jenkins-hbase9.apache.org/39559] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 20:59:34,164 INFO [Listener at jenkins-hbase9.apache.org/39559] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 20:59:34,258 INFO [Listener at jenkins-hbase9.apache.org/39559] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 20:59:34,267 INFO [Listener at jenkins-hbase9.apache.org/39559] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:32799 2023-09-12 20:59:34,424 WARN [Listener at jenkins-hbase9.apache.org/32837] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 20:59:34,432 WARN [Listener at jenkins-hbase9.apache.org/32837] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-12 20:59:34,433 INFO [Listener at jenkins-hbase9.apache.org/32837] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 20:59:34,442 INFO [Listener at jenkins-hbase9.apache.org/32837] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_34409_node____u217v9/webapp 2023-09-12 20:59:34,502 INFO [Listener at jenkins-hbase9.apache.org/32837] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-12 20:59:34,502 INFO [Listener at jenkins-hbase9.apache.org/32837] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-12 20:59:34,502 INFO [Listener at jenkins-hbase9.apache.org/32837] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-12 20:59:34,502 INFO [Listener at jenkins-hbase9.apache.org/32837] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-12 20:59:34,510 INFO [Listener at jenkins-hbase9.apache.org/32837] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 20:59:34,526 INFO [Listener at jenkins-hbase9.apache.org/32837] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 20:59:34,591 INFO [Listener at jenkins-hbase9.apache.org/32837] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 20:59:34,599 INFO [Listener at jenkins-hbase9.apache.org/32837] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:34409 2023-09-12 20:59:34,619 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-12 20:59:34,621 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 20:59:34,683 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=147, ProcessCount=165, AvailableMemoryMB=6894 2023-09-12 20:59:34,683 WARN [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-09-12 20:59:34,696 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 20:59:34,697 DEBUG [Listener at jenkins-hbase9.apache.org/32837] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-12 20:59:34,707 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-12 20:59:34,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-12 20:59:34,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-12 20:59:34,731 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 20:59:34,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-12 20:59:34,735 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 20:59:34,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-12 20:59:34,739 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5 2023-09-12 20:59:34,740 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5 empty. 2023-09-12 20:59:34,741 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36 2023-09-12 20:59:34,742 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5 2023-09-12 20:59:34,742 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36 empty. 2023-09-12 20:59:34,743 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36 2023-09-12 20:59:34,743 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-12 20:59:34,785 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-12 20:59:34,787 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 640eea2d0479be2b91a6140809b14be5, NAME => 'testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 20:59:34,787 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0b9a763c7f0becaf346766b1e8de2b36, NAME => 'testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 20:59:34,836 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:34,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 640eea2d0479be2b91a6140809b14be5, disabling compactions & flushes 2023-09-12 20:59:34,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:34,837 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:34,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 0b9a763c7f0becaf346766b1e8de2b36, disabling compactions & flushes 2023-09-12 20:59:34,838 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:34,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:34,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. after waiting 0 ms 2023-09-12 20:59:34,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:34,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:34,838 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:34,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. after waiting 0 ms 2023-09-12 20:59:34,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 0b9a763c7f0becaf346766b1e8de2b36: 2023-09-12 20:59:34,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:34,838 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:34,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 640eea2d0479be2b91a6140809b14be5: 2023-09-12 20:59:34,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-12 20:59:34,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 20:59:34,848 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694552374847"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552374847"}]},"ts":"1694552374847"} 2023-09-12 20:59:34,848 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694552374847"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552374847"}]},"ts":"1694552374847"} 2023-09-12 20:59:34,891 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-12 20:59:34,893 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-12 20:59:34,894 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-12 20:59:34,914 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 20:59:34,915 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 20:59:34,915 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552374915"}]},"ts":"1694552374915"} 2023-09-12 20:59:34,918 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-12 20:59:34,922 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-12 20:59:34,925 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 20:59:34,925 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 20:59:34,925 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 20:59:34,925 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 20:59:34,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=640eea2d0479be2b91a6140809b14be5, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0b9a763c7f0becaf346766b1e8de2b36, ASSIGN}] 2023-09-12 20:59:34,928 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=640eea2d0479be2b91a6140809b14be5, ASSIGN 2023-09-12 20:59:34,928 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0b9a763c7f0becaf346766b1e8de2b36, ASSIGN 2023-09-12 20:59:34,929 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=640eea2d0479be2b91a6140809b14be5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34031,1694552367245; forceNewPlan=false, retain=false 2023-09-12 20:59:34,929 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0b9a763c7f0becaf346766b1e8de2b36, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45939,1694552367290; forceNewPlan=false, retain=false 2023-09-12 20:59:35,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-12 20:59:35,080 INFO [jenkins-hbase9:38453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 20:59:35,083 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=640eea2d0479be2b91a6140809b14be5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:35,083 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0b9a763c7f0becaf346766b1e8de2b36, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:35,083 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694552375083"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552375083"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552375083"}]},"ts":"1694552375083"} 2023-09-12 20:59:35,083 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694552375083"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552375083"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552375083"}]},"ts":"1694552375083"} 2023-09-12 20:59:35,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 0b9a763c7f0becaf346766b1e8de2b36, server=jenkins-hbase9.apache.org,45939,1694552367290}] 2023-09-12 20:59:35,088 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 640eea2d0479be2b91a6140809b14be5, server=jenkins-hbase9.apache.org,34031,1694552367245}] 2023-09-12 20:59:35,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:35,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b9a763c7f0becaf346766b1e8de2b36, NAME => 'testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36.', STARTKEY => '1', ENDKEY => ''} 2023-09-12 20:59:35,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. service=AccessControlService 2023-09-12 20:59:35,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 20:59:35,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 0b9a763c7f0becaf346766b1e8de2b36 2023-09-12 20:59:35,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:35,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 0b9a763c7f0becaf346766b1e8de2b36 2023-09-12 20:59:35,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 0b9a763c7f0becaf346766b1e8de2b36 2023-09-12 20:59:35,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:35,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 640eea2d0479be2b91a6140809b14be5, NAME => 'testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5.', STARTKEY => '', ENDKEY => '1'} 2023-09-12 20:59:35,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. service=AccessControlService 2023-09-12 20:59:35,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 20:59:35,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 640eea2d0479be2b91a6140809b14be5 2023-09-12 20:59:35,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:35,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 640eea2d0479be2b91a6140809b14be5 2023-09-12 20:59:35,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 640eea2d0479be2b91a6140809b14be5 2023-09-12 20:59:35,250 INFO [StoreOpener-640eea2d0479be2b91a6140809b14be5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 640eea2d0479be2b91a6140809b14be5 2023-09-12 20:59:35,250 INFO [StoreOpener-0b9a763c7f0becaf346766b1e8de2b36-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0b9a763c7f0becaf346766b1e8de2b36 2023-09-12 20:59:35,251 DEBUG [StoreOpener-640eea2d0479be2b91a6140809b14be5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/cf 2023-09-12 20:59:35,251 DEBUG [StoreOpener-640eea2d0479be2b91a6140809b14be5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/cf 2023-09-12 20:59:35,252 DEBUG [StoreOpener-0b9a763c7f0becaf346766b1e8de2b36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/cf 2023-09-12 20:59:35,252 DEBUG [StoreOpener-0b9a763c7f0becaf346766b1e8de2b36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/cf 2023-09-12 20:59:35,255 INFO [StoreOpener-0b9a763c7f0becaf346766b1e8de2b36-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b9a763c7f0becaf346766b1e8de2b36 columnFamilyName cf 2023-09-12 20:59:35,255 INFO [StoreOpener-640eea2d0479be2b91a6140809b14be5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 640eea2d0479be2b91a6140809b14be5 columnFamilyName cf 2023-09-12 20:59:35,258 INFO [StoreOpener-640eea2d0479be2b91a6140809b14be5-1] regionserver.HStore(310): Store=640eea2d0479be2b91a6140809b14be5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 20:59:35,258 INFO [StoreOpener-0b9a763c7f0becaf346766b1e8de2b36-1] regionserver.HStore(310): Store=0b9a763c7f0becaf346766b1e8de2b36/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 20:59:35,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5 2023-09-12 20:59:35,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5 2023-09-12 20:59:35,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 640eea2d0479be2b91a6140809b14be5 2023-09-12 20:59:35,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36 2023-09-12 20:59:35,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 20:59:35,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36 2023-09-12 20:59:35,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 640eea2d0479be2b91a6140809b14be5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68417855, jitterRate=0.019505485892295837}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 20:59:35,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 640eea2d0479be2b91a6140809b14be5: 2023-09-12 20:59:35,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5., pid=16, masterSystemTime=1694552375240 2023-09-12 20:59:35,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:35,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:35,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 0b9a763c7f0becaf346766b1e8de2b36 2023-09-12 20:59:35,278 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=640eea2d0479be2b91a6140809b14be5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:35,279 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694552375278"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552375278"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552375278"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552375278"}]},"ts":"1694552375278"} 2023-09-12 20:59:35,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 20:59:35,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 0b9a763c7f0becaf346766b1e8de2b36; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63948764, jitterRate=-0.04708915948867798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 20:59:35,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 0b9a763c7f0becaf346766b1e8de2b36: 2023-09-12 20:59:35,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36., pid=15, masterSystemTime=1694552375239 2023-09-12 20:59:35,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:35,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:35,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-12 20:59:35,290 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0b9a763c7f0becaf346766b1e8de2b36, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:35,291 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 640eea2d0479be2b91a6140809b14be5, server=jenkins-hbase9.apache.org,34031,1694552367245 in 194 msec 2023-09-12 20:59:35,291 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694552375286"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552375286"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552375286"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552375286"}]},"ts":"1694552375286"} 2023-09-12 20:59:35,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=640eea2d0479be2b91a6140809b14be5, ASSIGN in 365 msec 2023-09-12 20:59:35,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-12 20:59:35,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 0b9a763c7f0becaf346766b1e8de2b36, server=jenkins-hbase9.apache.org,45939,1694552367290 in 208 msec 2023-09-12 20:59:35,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-12 20:59:35,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0b9a763c7f0becaf346766b1e8de2b36, ASSIGN in 373 msec 2023-09-12 20:59:35,302 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 20:59:35,302 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552375302"}]},"ts":"1694552375302"} 2023-09-12 20:59:35,304 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-12 20:59:35,313 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 20:59:35,320 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-12 20:59:35,325 DEBUG [PEWorker-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:35,328 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:35,332 DEBUG [hconnection-0x36cb2601-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:35,334 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-09-12 20:59:35,341 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-12 20:59:35,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-12 20:59:35,372 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-12 20:59:35,372 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-12 20:59:35,372 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 20:59:35,372 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-12 20:59:35,372 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-12 20:59:35,382 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-12 20:59:35,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-12 20:59:35,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-12 20:59:35,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-12 20:59:35,383 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-12 20:59:35,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 661 msec 2023-09-12 20:59:35,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-12 20:59:35,845 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-12 20:59:35,849 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-12 20:59:35,850 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:35,852 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 20:59:35,876 DEBUG [hconnection-0x6ce6cf7c-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:35,879 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:35,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-12 20:59:35,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694552375892 (current time:1694552375892). 2023-09-12 20:59:35,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 20:59:35,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x523ab9bc to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 20:59:35,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14103610, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 20:59:35,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:35,903 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:35,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x523ab9bc to 127.0.0.1:58083 2023-09-12 20:59:35,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 20:59:35,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x258cec5e to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 20:59:35,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57690469, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 20:59:35,914 DEBUG [hconnection-0x2afa2cab-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:35,915 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:35,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:35,921 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:35,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x258cec5e to 127.0.0.1:58083 2023-09-12 20:59:35,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 20:59:35,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-12 20:59:35,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 20:59:35,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-12 20:59:35,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-12 20:59:35,964 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-12 20:59:35,966 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694552975966 2023-09-12 20:59:35,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-12 20:59:35,966 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-12 20:59:35,968 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-12 20:59:35,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-12 20:59:35,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 12 msec 2023-09-12 20:59:35,971 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-12 20:59:35,972 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694552975972 2023-09-12 20:59:35,973 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 20:59:35,973 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 20:59:36,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,002 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-12 20:59:36,002 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:36,003 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-12 20:59:36,003 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-12 20:59:36,004 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,004 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,009 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:36,009 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,009 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:36,009 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:36,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:36,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:36,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:36,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:36,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:36,010 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:36,010 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,010 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,010 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 20:59:36,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-12 20:59:36,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-12 20:59:36,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-12 20:59:36,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-12 20:59:36,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-12 20:59:36,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-12 20:59:36,015 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,015 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,016 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-12 20:59:36,016 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:36,017 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-12 20:59:36,017 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-12 20:59:36,017 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-12 20:59:36,017 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-12 20:59:36,017 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-12 20:59:36,017 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:36,017 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:36,018 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-12 20:59:36,019 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-12 20:59:36,019 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-12 20:59:36,019 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-12 20:59:36,019 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-12 20:59:36,019 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-12 20:59:36,021 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,021 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:36,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:36,023 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,024 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,024 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,024 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 20:59:36,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:36,024 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,024 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 20:59:36,024 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,025 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,025 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 20:59:36,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:36,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:36,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-12 20:59:36,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c6b9ab3[Count = 1] remaining members to acquire global barrier 2023-09-12 20:59:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:36,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:36,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:36,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-12 20:59:36,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c6b9ab3[Count = 0] remaining members to acquire global barrier 2023-09-12 20:59:36,030 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-12 20:59:36,030 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,032 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,032 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,032 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,032 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-12 20:59:36,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,032 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,032 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-12 20:59:36,033 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-12 20:59:36,033 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-12 20:59:36,033 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,42813,1694552367323' in zk 2023-09-12 20:59:36,033 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,033 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 20:59:36,033 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 20:59:36,033 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 20:59:36,033 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:36,034 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. started... 2023-09-12 20:59:36,037 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 20:59:36,037 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:36,037 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 20:59:36,037 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. started... 2023-09-12 20:59:36,037 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-12 20:59:36,037 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:36,037 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-12 20:59:36,039 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b9a763c7f0becaf346766b1e8de2b36: 2023-09-12 20:59:36,039 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 640eea2d0479be2b91a6140809b14be5: 2023-09-12 20:59:36,040 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,040 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,045 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 20:59:36,045 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 20:59:36,049 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 20:59:36,049 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 20:59:36,074 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 20:59:36,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-12 20:59:36,082 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. completed. 2023-09-12 20:59:36,082 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:36,083 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 20:59:36,083 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 20:59:36,083 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-12 20:59:36,083 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-12 20:59:36,083 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,45939,1694552367290' in zk 2023-09-12 20:59:36,083 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 20:59:36,085 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. completed. 2023-09-12 20:59:36,085 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:36,085 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 20:59:36,085 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 20:59:36,085 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,085 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-12 20:59:36,085 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,34031,1694552367245' in zk 2023-09-12 20:59:36,086 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,086 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-12 20:59:36,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:36,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:36,086 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:36,086 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-12 20:59:36,088 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-12 20:59:36,088 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:36,088 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:36,089 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-12 20:59:36,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:36,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:36,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,45939,1694552367290': 2023-09-12 20:59:36,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-12 20:59:36,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:36,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:36,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:36,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:36,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:36,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,34031,1694552367245': 2023-09-12 20:59:36,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-12 20:59:36,098 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-12 20:59:36,098 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 20:59:36,099 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 20:59:36,099 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,099 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 20:59:36,102 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,102 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:36,102 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:36,102 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,102 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,102 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:36,102 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:36,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,103 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:36,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:36,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:36,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:36,104 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,105 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:36,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,109 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,109 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,109 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,122 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,122 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:36,122 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:36,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:36,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:36,122 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,122 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:36,122 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,122 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:36,122 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,122 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:36,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:36,122 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,122 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:36,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:36,123 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:36,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:36,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:36,123 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:36,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-12 20:59:36,123 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:36,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,124 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:36,124 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 20:59:36,124 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:36,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:36,124 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:36,124 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-12 20:59:36,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,188 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-12 20:59:36,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,189 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:36,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694552375966Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694552376140 (+174 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1694552376140Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1694552376140Writing data manifest for emptySnaptb0-testExportWithTargetName at 1694552376153 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1694552376176 (+23 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694552376188 (+12 ms) 2023-09-12 20:59:36,190 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-12 20:59:36,191 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 20:59:36,192 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-12 20:59:36,192 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 20:59:36,192 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-12 20:59:36,193 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-12 20:59:36,193 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-12 20:59:36,193 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 20:59:36,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 223 msec 2023-09-12 20:59:36,193 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-12 20:59:36,193 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-12 20:59:36,193 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-12 20:59:36,283 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 20:59:36,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-12 20:59:36,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 20:59:36,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34031] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 20:59:36,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45939] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 20:59:36,303 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-12 20:59:36,303 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:36,303 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 20:59:36,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-12 20:59:36,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694552376318 (current time:1694552376318). 2023-09-12 20:59:36,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 20:59:36,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x43a24658 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 20:59:36,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27b91659, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 20:59:36,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:36,329 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:36,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43a24658 to 127.0.0.1:58083 2023-09-12 20:59:36,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 20:59:36,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x67c4e93d to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 20:59:36,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3605e31b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 20:59:36,337 DEBUG [hconnection-0x5961205c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:36,339 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:36,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:36,345 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:36,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67c4e93d to 127.0.0.1:58083 2023-09-12 20:59:36,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 20:59:36,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-12 20:59:36,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 20:59:36,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-12 20:59:36,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-12 20:59:36,352 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-12 20:59:36,353 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694552976353 2023-09-12 20:59:36,353 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-12 20:59:36,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-12 20:59:36,354 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 20:59:36,354 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 20:59:36,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-12 20:59:36,355 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-12 20:59:36,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-12 20:59:36,358 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-12 20:59:36,359 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694552976359 2023-09-12 20:59:36,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-12 20:59:36,372 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-12 20:59:36,372 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:36,373 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-12 20:59:36,373 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-12 20:59:36,374 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,374 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,376 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:36,376 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:36,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:36,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:36,376 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:36,376 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:36,377 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,377 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,377 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,377 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 20:59:36,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-12 20:59:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-12 20:59:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,378 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-12 20:59:36,378 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-12 20:59:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-12 20:59:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,378 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-12 20:59:36,378 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-12 20:59:36,378 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-12 20:59:36,378 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-12 20:59:36,381 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:36,381 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-12 20:59:36,381 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:36,382 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-12 20:59:36,383 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-12 20:59:36,383 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-12 20:59:36,383 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-12 20:59:36,383 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-12 20:59:36,383 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-12 20:59:36,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-12 20:59:36,383 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-12 20:59:36,383 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:36,384 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-12 20:59:36,384 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-12 20:59:36,384 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-12 20:59:36,387 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,388 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,388 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:36,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:36,389 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,389 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,389 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,389 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 20:59:36,389 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,389 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 20:59:36,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:36,389 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,389 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 20:59:36,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:36,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 20:59:36,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:36,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-12 20:59:36,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2497b049[Count = 1] remaining members to acquire global barrier 2023-09-12 20:59:36,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:36,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:36,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:36,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 20:59:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:36,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-12 20:59:36,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2497b049[Count = 0] remaining members to acquire global barrier 2023-09-12 20:59:36,394 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-12 20:59:36,394 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,399 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,399 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,399 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,400 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,400 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-12 20:59:36,400 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-12 20:59:36,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,400 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 20:59:36,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,400 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:36,400 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,400 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 20:59:36,400 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-12 20:59:36,400 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. started... 2023-09-12 20:59:36,400 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-12 20:59:36,400 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 20:59:36,400 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,42813,1694552367323' in zk 2023-09-12 20:59:36,400 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 640eea2d0479be2b91a6140809b14be5 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-12 20:59:36,400 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:36,400 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 20:59:36,401 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 20:59:36,400 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. started... 2023-09-12 20:59:36,401 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0b9a763c7f0becaf346766b1e8de2b36 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-12 20:59:36,403 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-12 20:59:36,403 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:36,403 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-12 20:59:36,455 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 20:59:36,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-12 20:59:36,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-12 20:59:36,456 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 20:59:36,537 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230912c2652f54b98f4c2c84d35c5070ffa6ad to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230912c2652f54b98f4c2c84d35c5070ffa6ad 2023-09-12 20:59:36,537 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230912672d60a8993c479bbfe60cec1ffe822b to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230912672d60a8993c479bbfe60cec1ffe822b 2023-09-12 20:59:36,570 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/.tmp/cf/e5e4b894df064c3498e671f19fcb7d20 2023-09-12 20:59:36,572 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/.tmp/cf/b6b773c65cd840c8a912b50fc02c3f03 2023-09-12 20:59:36,582 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/.tmp/cf/b6b773c65cd840c8a912b50fc02c3f03 as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/cf/b6b773c65cd840c8a912b50fc02c3f03 2023-09-12 20:59:36,582 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/.tmp/cf/e5e4b894df064c3498e671f19fcb7d20 as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/cf/e5e4b894df064c3498e671f19fcb7d20 2023-09-12 20:59:36,590 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/cf/b6b773c65cd840c8a912b50fc02c3f03, entries=47, sequenceid=6, filesize=12.8 K 2023-09-12 20:59:36,592 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/cf/e5e4b894df064c3498e671f19fcb7d20, entries=3, sequenceid=6, filesize=5.4 K 2023-09-12 20:59:36,594 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 0b9a763c7f0becaf346766b1e8de2b36 in 193ms, sequenceid=6, compaction requested=false 2023-09-12 20:59:36,594 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 640eea2d0479be2b91a6140809b14be5 in 194ms, sequenceid=6, compaction requested=false 2023-09-12 20:59:36,595 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-12 20:59:36,595 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-12 20:59:36,597 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 640eea2d0479be2b91a6140809b14be5: 2023-09-12 20:59:36,597 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b9a763c7f0becaf346766b1e8de2b36: 2023-09-12 20:59:36,597 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-12 20:59:36,597 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-12 20:59:36,597 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 20:59:36,597 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 20:59:36,597 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/cf/e5e4b894df064c3498e671f19fcb7d20] hfiles 2023-09-12 20:59:36,597 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/cf/b6b773c65cd840c8a912b50fc02c3f03] hfiles 2023-09-12 20:59:36,598 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/cf/e5e4b894df064c3498e671f19fcb7d20 for snapshot=snaptb0-testExportWithTargetName 2023-09-12 20:59:36,598 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/cf/b6b773c65cd840c8a912b50fc02c3f03 for snapshot=snaptb0-testExportWithTargetName 2023-09-12 20:59:36,620 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. completed. 2023-09-12 20:59:36,620 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:36,620 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 20:59:36,620 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 20:59:36,620 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,620 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-12 20:59:36,620 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,45939,1694552367290' in zk 2023-09-12 20:59:36,620 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. completed. 2023-09-12 20:59:36,621 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:36,621 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 20:59:36,621 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 20:59:36,621 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,621 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-12 20:59:36,621 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,34031,1694552367245' in zk 2023-09-12 20:59:36,622 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,622 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-12 20:59:36,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:36,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:36,622 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:36,623 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-12 20:59:36,624 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-12 20:59:36,624 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:36,624 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:36,624 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-12 20:59:36,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:36,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 20:59:36,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:36,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 20:59:36,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,45939,1694552367290': 2023-09-12 20:59:36,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-12 20:59:36,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:36,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:36,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:36,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:36,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 20:59:36,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:36,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 20:59:36,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,34031,1694552367245': 2023-09-12 20:59:36,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-12 20:59:36,637 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-12 20:59:36,637 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 20:59:36,637 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 20:59:36,637 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-12 20:59:36,637 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 20:59:36,642 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,642 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:36,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:36,642 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:36,642 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,642 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,643 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:36,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:36,643 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:36,643 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 20:59:36,643 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:36,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:36,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:36,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:36,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:36,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:36,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:36,644 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 20:59:36,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:36,646 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 20:59:36,647 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,647 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,658 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 20:59:36,659 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:36,659 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:36,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-12 20:59:36,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:36,659 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:36,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:36,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-12 20:59:36,659 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:36,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:36,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:36,659 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:36,659 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:36,660 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,660 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-12 20:59:36,660 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:36,659 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-12 20:59:36,659 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:36,661 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-12 20:59:36,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:36,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:36,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-12 20:59:36,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 20:59:36,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:36,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:36,660 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,661 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,661 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,662 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:36,662 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,662 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:36,662 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:36,662 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,662 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:36,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:36,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:36,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230912672d60a8993c479bbfe60cec1ffe822b, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230912c2652f54b98f4c2c84d35c5070ffa6ad] mob files 2023-09-12 20:59:36,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230912672d60a8993c479bbfe60cec1ffe822b 2023-09-12 20:59:36,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230912c2652f54b98f4c2c84d35c5070ffa6ad 2023-09-12 20:59:36,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-12 20:59:36,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,718 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-12 20:59:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,719 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-12 20:59:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694552376353Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694552376677 (+324 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1694552376677Loading Region manifests for snaptb0-testExportWithTargetName at 1694552376678 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1694552376683 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1694552376707 (+24 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694552376718 (+11 ms) 2023-09-12 20:59:36,721 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-12 20:59:36,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 367 msec 2023-09-12 20:59:36,961 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 20:59:36,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-12 20:59:36,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 20:59:36,964 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552376964 2023-09-12 20:59:36,964 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38861, tgtDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552376964, rawTgtDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552376964, srcFsUri=hdfs://localhost:38861, srcDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 20:59:37,000 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 20:59:37,000 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_39991602_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552376964, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552376964/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-12 20:59:37,000 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944, snapshotDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-12 20:59:37,018 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552376964/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-12 20:59:37,070 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:37,071 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:37,071 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:37,072 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:37,947 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-4773636914113014620.jar 2023-09-12 20:59:37,948 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:37,948 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:38,014 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-1545255827560534105.jar 2023-09-12 20:59:38,014 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:38,015 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:38,016 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:38,016 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:38,017 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:38,018 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:38,018 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 20:59:38,019 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 20:59:38,020 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 20:59:38,021 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 20:59:38,021 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 20:59:38,022 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 20:59:38,023 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 20:59:38,023 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 20:59:38,024 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 20:59:38,025 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 20:59:38,030 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 20:59:38,031 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 20:59:38,031 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 20:59:38,032 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 20:59:38,032 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 20:59:38,033 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 20:59:38,033 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 20:59:38,834 WARN [Listener at jenkins-hbase9.apache.org/32837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 20:59:38,840 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-12 20:59:38,850 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-12 20:59:39,313 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 20:59:39,315 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 20:59:39,530 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0001_000001 (auth:SIMPLE) 2023-09-12 20:59:40,753 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 20:59:43,845 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0001_000001 (auth:SIMPLE) 2023-09-12 20:59:46,081 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0001_000001 (auth:SIMPLE) 2023-09-12 20:59:48,684 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0001_000001 (auth:SIMPLE) 2023-09-12 20:59:50,697 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 20:59:50,700 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 20:59:50,712 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-12 20:59:50,713 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 20:59:50,714 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 20:59:50,714 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-480281790_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-12 20:59:50,714 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-12 20:59:50,714 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-12 20:59:50,714 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-480281790_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552376964/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552376964/.hbase-snapshot/testExportWithTargetName 2023-09-12 20:59:50,715 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552376964/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-12 20:59:50,715 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552376964/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-12 20:59:50,726 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-12 20:59:50,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-09-12 20:59:50,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-12 20:59:50,743 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552390742"}]},"ts":"1694552390742"} 2023-09-12 20:59:50,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-12 20:59:50,744 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-12 20:59:50,746 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-12 20:59:50,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=640eea2d0479be2b91a6140809b14be5, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0b9a763c7f0becaf346766b1e8de2b36, UNASSIGN}] 2023-09-12 20:59:50,750 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=640eea2d0479be2b91a6140809b14be5, UNASSIGN 2023-09-12 20:59:50,750 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0b9a763c7f0becaf346766b1e8de2b36, UNASSIGN 2023-09-12 20:59:50,751 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0b9a763c7f0becaf346766b1e8de2b36, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:50,751 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=640eea2d0479be2b91a6140809b14be5, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:50,751 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694552390751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552390751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552390751"}]},"ts":"1694552390751"} 2023-09-12 20:59:50,751 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694552390751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552390751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552390751"}]},"ts":"1694552390751"} 2023-09-12 20:59:50,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 640eea2d0479be2b91a6140809b14be5, server=jenkins-hbase9.apache.org,34031,1694552367245}] 2023-09-12 20:59:50,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 0b9a763c7f0becaf346766b1e8de2b36, server=jenkins-hbase9.apache.org,45939,1694552367290}] 2023-09-12 20:59:50,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-12 20:59:50,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 0b9a763c7f0becaf346766b1e8de2b36 2023-09-12 20:59:50,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 640eea2d0479be2b91a6140809b14be5 2023-09-12 20:59:50,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 0b9a763c7f0becaf346766b1e8de2b36, disabling compactions & flushes 2023-09-12 20:59:50,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 640eea2d0479be2b91a6140809b14be5, disabling compactions & flushes 2023-09-12 20:59:50,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:50,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:50,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:50,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:50,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. after waiting 0 ms 2023-09-12 20:59:50,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:50,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. after waiting 0 ms 2023-09-12 20:59:50,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:50,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 20:59:50,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 20:59:50,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 20:59:50,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 20:59:50,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5. 2023-09-12 20:59:50,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36. 2023-09-12 20:59:50,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 0b9a763c7f0becaf346766b1e8de2b36: 2023-09-12 20:59:50,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 640eea2d0479be2b91a6140809b14be5: 2023-09-12 20:59:50,942 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=640eea2d0479be2b91a6140809b14be5, regionState=CLOSED 2023-09-12 20:59:50,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 640eea2d0479be2b91a6140809b14be5 2023-09-12 20:59:50,942 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694552390942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552390942"}]},"ts":"1694552390942"} 2023-09-12 20:59:50,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 0b9a763c7f0becaf346766b1e8de2b36 2023-09-12 20:59:50,943 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0b9a763c7f0becaf346766b1e8de2b36, regionState=CLOSED 2023-09-12 20:59:50,943 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694552390943"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552390943"}]},"ts":"1694552390943"} 2023-09-12 20:59:50,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-12 20:59:50,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 640eea2d0479be2b91a6140809b14be5, server=jenkins-hbase9.apache.org,34031,1694552367245 in 191 msec 2023-09-12 20:59:50,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-12 20:59:50,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 0b9a763c7f0becaf346766b1e8de2b36, server=jenkins-hbase9.apache.org,45939,1694552367290 in 191 msec 2023-09-12 20:59:50,952 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=640eea2d0479be2b91a6140809b14be5, UNASSIGN in 199 msec 2023-09-12 20:59:50,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-12 20:59:50,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0b9a763c7f0becaf346766b1e8de2b36, UNASSIGN in 200 msec 2023-09-12 20:59:50,955 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552390955"}]},"ts":"1694552390955"} 2023-09-12 20:59:50,957 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-12 20:59:50,958 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-12 20:59:50,961 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 226 msec 2023-09-12 20:59:51,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-12 20:59:51,046 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-12 20:59:51,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-09-12 20:59:51,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-12 20:59:51,060 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-12 20:59:51,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-12 20:59:51,062 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-12 20:59:51,065 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-12 20:59:51,068 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5 2023-09-12 20:59:51,068 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36 2023-09-12 20:59:51,069 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-12 20:59:51,069 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-12 20:59:51,069 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-12 20:59:51,069 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-12 20:59:51,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-12 20:59:51,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-12 20:59:51,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-12 20:59:51,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-12 20:59:51,071 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-12 20:59:51,071 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 20:59:51,071 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-12 20:59:51,071 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 20:59:51,071 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-12 20:59:51,071 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 20:59:51,072 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-12 20:59:51,072 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 20:59:51,073 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/recovered.edits] 2023-09-12 20:59:51,073 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/recovered.edits] 2023-09-12 20:59:51,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-12 20:59:51,081 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/cf/b6b773c65cd840c8a912b50fc02c3f03 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/cf/b6b773c65cd840c8a912b50fc02c3f03 2023-09-12 20:59:51,081 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/cf/e5e4b894df064c3498e671f19fcb7d20 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/cf/e5e4b894df064c3498e671f19fcb7d20 2023-09-12 20:59:51,086 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/recovered.edits/9.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5/recovered.edits/9.seqid 2023-09-12 20:59:51,086 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/recovered.edits/9.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36/recovered.edits/9.seqid 2023-09-12 20:59:51,086 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/640eea2d0479be2b91a6140809b14be5 2023-09-12 20:59:51,086 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportWithTargetName/0b9a763c7f0becaf346766b1e8de2b36 2023-09-12 20:59:51,086 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-12 20:59:51,087 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-12 20:59:51,088 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-12 20:59:51,092 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230912672d60a8993c479bbfe60cec1ffe822b to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230912672d60a8993c479bbfe60cec1ffe822b 2023-09-12 20:59:51,094 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230912c2652f54b98f4c2c84d35c5070ffa6ad to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230912c2652f54b98f4c2c84d35c5070ffa6ad 2023-09-12 20:59:51,094 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-12 20:59:51,097 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-12 20:59:51,119 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-12 20:59:51,122 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-12 20:59:51,123 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-12 20:59:51,123 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-12 20:59:51,124 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694552391123"}]},"ts":"9223372036854775807"} 2023-09-12 20:59:51,124 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694552391123"}]},"ts":"9223372036854775807"} 2023-09-12 20:59:51,126 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-12 20:59:51,126 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 640eea2d0479be2b91a6140809b14be5, NAME => 'testtb-testExportWithTargetName,,1694552374722.640eea2d0479be2b91a6140809b14be5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0b9a763c7f0becaf346766b1e8de2b36, NAME => 'testtb-testExportWithTargetName,1,1694552374722.0b9a763c7f0becaf346766b1e8de2b36.', STARTKEY => '1', ENDKEY => ''}] 2023-09-12 20:59:51,126 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-12 20:59:51,126 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694552391126"}]},"ts":"9223372036854775807"} 2023-09-12 20:59:51,128 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-12 20:59:51,131 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-12 20:59:51,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 79 msec 2023-09-12 20:59:51,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-12 20:59:51,178 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-12 20:59:51,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-12 20:59:51,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-12 20:59:51,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-09-12 20:59:51,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-12 20:59:51,232 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 705) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1805851284_1 at /127.0.0.1:46148 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (640167340) connection to jenkins-hbase9.apache.org/172.31.2.10:41859 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:46170 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (640167340) connection to jenkins-hbase9.apache.org/172.31.2.10:43713 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1805851284_1 at /127.0.0.1:40696 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:40710 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:45094 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (640167340) connection to jenkins-hbase9.apache.org/172.31.2.10:39559 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=926 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=221 (was 147) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=6112 (was 6894) 2023-09-12 20:59:51,232 WARN [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-12 20:59:51,250 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=221, ProcessCount=168, AvailableMemoryMB=6111 2023-09-12 20:59:51,250 WARN [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-12 20:59:51,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-12 20:59:51,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-12 20:59:51,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 20:59:51,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-12 20:59:51,258 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 20:59:51,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-12 20:59:51,260 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222 2023-09-12 20:59:51,260 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b 2023-09-12 20:59:51,261 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222 empty. 2023-09-12 20:59:51,261 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b empty. 2023-09-12 20:59:51,261 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222 2023-09-12 20:59:51,261 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b 2023-09-12 20:59:51,262 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-12 20:59:51,275 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-12 20:59:51,276 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8fd1b3c56d8967053c0d0f19d998271b, NAME => 'testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 20:59:51,277 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1f4ea0d785a433b1fee2257a5b350222, NAME => 'testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 20:59:51,310 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:51,311 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:51,312 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8fd1b3c56d8967053c0d0f19d998271b, disabling compactions & flushes 2023-09-12 20:59:51,312 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 1f4ea0d785a433b1fee2257a5b350222, disabling compactions & flushes 2023-09-12 20:59:51,312 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 20:59:51,312 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 20:59:51,312 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 20:59:51,312 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 20:59:51,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. after waiting 0 ms 2023-09-12 20:59:51,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. after waiting 0 ms 2023-09-12 20:59:51,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 20:59:51,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 20:59:51,313 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 20:59:51,313 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 20:59:51,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8fd1b3c56d8967053c0d0f19d998271b: 2023-09-12 20:59:51,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 1f4ea0d785a433b1fee2257a5b350222: 2023-09-12 20:59:51,316 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 20:59:51,317 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694552391317"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552391317"}]},"ts":"1694552391317"} 2023-09-12 20:59:51,317 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694552391317"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552391317"}]},"ts":"1694552391317"} 2023-09-12 20:59:51,320 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 20:59:51,321 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 20:59:51,321 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552391321"}]},"ts":"1694552391321"} 2023-09-12 20:59:51,323 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-12 20:59:51,327 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-12 20:59:51,328 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 20:59:51,329 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 20:59:51,329 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 20:59:51,329 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 20:59:51,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1f4ea0d785a433b1fee2257a5b350222, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd1b3c56d8967053c0d0f19d998271b, ASSIGN}] 2023-09-12 20:59:51,331 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1f4ea0d785a433b1fee2257a5b350222, ASSIGN 2023-09-12 20:59:51,331 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd1b3c56d8967053c0d0f19d998271b, ASSIGN 2023-09-12 20:59:51,332 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd1b3c56d8967053c0d0f19d998271b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34031,1694552367245; forceNewPlan=false, retain=false 2023-09-12 20:59:51,332 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1f4ea0d785a433b1fee2257a5b350222, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42813,1694552367323; forceNewPlan=false, retain=false 2023-09-12 20:59:51,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-12 20:59:51,483 INFO [jenkins-hbase9:38453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 20:59:51,485 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1f4ea0d785a433b1fee2257a5b350222, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,485 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8fd1b3c56d8967053c0d0f19d998271b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,485 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694552391485"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552391485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552391485"}]},"ts":"1694552391485"} 2023-09-12 20:59:51,485 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694552391485"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552391485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552391485"}]},"ts":"1694552391485"} 2023-09-12 20:59:51,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 1f4ea0d785a433b1fee2257a5b350222, server=jenkins-hbase9.apache.org,42813,1694552367323}] 2023-09-12 20:59:51,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 8fd1b3c56d8967053c0d0f19d998271b, server=jenkins-hbase9.apache.org,34031,1694552367245}] 2023-09-12 20:59:51,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-12 20:59:51,641 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,641 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-12 20:59:51,645 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-12 20:59:51,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 20:59:51,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8fd1b3c56d8967053c0d0f19d998271b, NAME => 'testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b.', STARTKEY => '1', ENDKEY => ''} 2023-09-12 20:59:51,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. service=AccessControlService 2023-09-12 20:59:51,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 20:59:51,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 8fd1b3c56d8967053c0d0f19d998271b 2023-09-12 20:59:51,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:51,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8fd1b3c56d8967053c0d0f19d998271b 2023-09-12 20:59:51,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8fd1b3c56d8967053c0d0f19d998271b 2023-09-12 20:59:51,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 20:59:51,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1f4ea0d785a433b1fee2257a5b350222, NAME => 'testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222.', STARTKEY => '', ENDKEY => '1'} 2023-09-12 20:59:51,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. service=AccessControlService 2023-09-12 20:59:51,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 20:59:51,655 INFO [StoreOpener-8fd1b3c56d8967053c0d0f19d998271b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8fd1b3c56d8967053c0d0f19d998271b 2023-09-12 20:59:51,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 1f4ea0d785a433b1fee2257a5b350222 2023-09-12 20:59:51,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 20:59:51,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1f4ea0d785a433b1fee2257a5b350222 2023-09-12 20:59:51,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1f4ea0d785a433b1fee2257a5b350222 2023-09-12 20:59:51,656 DEBUG [StoreOpener-8fd1b3c56d8967053c0d0f19d998271b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/cf 2023-09-12 20:59:51,656 DEBUG [StoreOpener-8fd1b3c56d8967053c0d0f19d998271b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/cf 2023-09-12 20:59:51,656 INFO [StoreOpener-1f4ea0d785a433b1fee2257a5b350222-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1f4ea0d785a433b1fee2257a5b350222 2023-09-12 20:59:51,657 INFO [StoreOpener-8fd1b3c56d8967053c0d0f19d998271b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fd1b3c56d8967053c0d0f19d998271b columnFamilyName cf 2023-09-12 20:59:51,658 DEBUG [StoreOpener-1f4ea0d785a433b1fee2257a5b350222-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/cf 2023-09-12 20:59:51,658 DEBUG [StoreOpener-1f4ea0d785a433b1fee2257a5b350222-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/cf 2023-09-12 20:59:51,658 INFO [StoreOpener-1f4ea0d785a433b1fee2257a5b350222-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f4ea0d785a433b1fee2257a5b350222 columnFamilyName cf 2023-09-12 20:59:51,658 INFO [StoreOpener-8fd1b3c56d8967053c0d0f19d998271b-1] regionserver.HStore(310): Store=8fd1b3c56d8967053c0d0f19d998271b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 20:59:51,660 INFO [StoreOpener-1f4ea0d785a433b1fee2257a5b350222-1] regionserver.HStore(310): Store=1f4ea0d785a433b1fee2257a5b350222/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 20:59:51,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b 2023-09-12 20:59:51,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b 2023-09-12 20:59:51,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222 2023-09-12 20:59:51,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222 2023-09-12 20:59:51,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8fd1b3c56d8967053c0d0f19d998271b 2023-09-12 20:59:51,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1f4ea0d785a433b1fee2257a5b350222 2023-09-12 20:59:51,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 20:59:51,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8fd1b3c56d8967053c0d0f19d998271b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69602529, jitterRate=0.037158504128456116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 20:59:51,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8fd1b3c56d8967053c0d0f19d998271b: 2023-09-12 20:59:51,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b., pid=31, masterSystemTime=1694552391642 2023-09-12 20:59:51,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 20:59:51,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 20:59:51,673 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8fd1b3c56d8967053c0d0f19d998271b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,676 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694552391672"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552391672"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552391672"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552391672"}]},"ts":"1694552391672"} 2023-09-12 20:59:51,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 20:59:51,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1f4ea0d785a433b1fee2257a5b350222; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68229892, jitterRate=0.01670461893081665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 20:59:51,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1f4ea0d785a433b1fee2257a5b350222: 2023-09-12 20:59:51,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222., pid=30, masterSystemTime=1694552391641 2023-09-12 20:59:51,683 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-12 20:59:51,683 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 8fd1b3c56d8967053c0d0f19d998271b, server=jenkins-hbase9.apache.org,34031,1694552367245 in 190 msec 2023-09-12 20:59:51,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 20:59:51,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 20:59:51,685 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1f4ea0d785a433b1fee2257a5b350222, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,685 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694552391684"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552391684"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552391684"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552391684"}]},"ts":"1694552391684"} 2023-09-12 20:59:51,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd1b3c56d8967053c0d0f19d998271b, ASSIGN in 354 msec 2023-09-12 20:59:51,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-12 20:59:51,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 1f4ea0d785a433b1fee2257a5b350222, server=jenkins-hbase9.apache.org,42813,1694552367323 in 200 msec 2023-09-12 20:59:51,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-12 20:59:51,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1f4ea0d785a433b1fee2257a5b350222, ASSIGN in 361 msec 2023-09-12 20:59:51,693 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 20:59:51,693 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552391693"}]},"ts":"1694552391693"} 2023-09-12 20:59:51,694 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-12 20:59:51,697 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 20:59:51,697 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-12 20:59:51,699 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-12 20:59:51,701 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 20:59:51,701 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 20:59:51,701 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 20:59:51,704 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 20:59:51,705 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 20:59:51,705 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 450 msec 2023-09-12 20:59:51,705 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 20:59:51,705 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 20:59:51,706 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 20:59:51,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-12 20:59:51,862 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-12 20:59:51,865 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-12 20:59:51,865 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 20:59:51,868 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 20:59:51,877 DEBUG [hconnection-0x6ce6cf7c-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:51,882 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:51,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 20:59:51,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694552391888 (current time:1694552391888). 2023-09-12 20:59:51,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 20:59:51,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x6382b023 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 20:59:51,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24c9ede8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 20:59:51,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:51,898 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:51,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6382b023 to 127.0.0.1:58083 2023-09-12 20:59:51,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 20:59:51,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x19133655 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 20:59:51,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fe69efc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 20:59:51,908 DEBUG [hconnection-0x4ab8845-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:51,911 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:51,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:51,916 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:51,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19133655 to 127.0.0.1:58083 2023-09-12 20:59:51,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 20:59:51,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-12 20:59:51,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 20:59:51,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 20:59:51,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-12 20:59:51,922 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-12 20:59:51,923 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694552991923 2023-09-12 20:59:51,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 20:59:51,923 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-12 20:59:51,924 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 20:59:51,925 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 20:59:51,926 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-12 20:59:51,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-12 20:59:51,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-12 20:59:51,928 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-12 20:59:51,928 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694552991928 2023-09-12 20:59:51,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,943 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-12 20:59:51,943 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:51,944 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-12 20:59:51,944 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-12 20:59:51,944 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,944 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,946 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,946 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:51,946 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:51,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:51,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:51,946 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:51,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:51,946 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,947 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:51,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:51,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:51,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,947 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,947 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 20:59:51,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-12 20:59:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-12 20:59:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-12 20:59:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-12 20:59:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-12 20:59:51,948 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-12 20:59:51,948 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:51,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-12 20:59:51,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,949 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-12 20:59:51,949 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-12 20:59:51,949 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:51,949 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-12 20:59:51,950 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-12 20:59:51,950 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-12 20:59:51,950 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-12 20:59:51,949 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,950 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-12 20:59:51,950 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-12 20:59:51,950 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:51,951 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-12 20:59:51,951 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-12 20:59:51,951 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-12 20:59:51,953 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,953 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:51,961 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,961 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,961 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:51,961 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,962 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 20:59:51,962 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,962 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 20:59:51,962 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:51,962 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 20:59:51,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:51,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-12 20:59:51,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35b18c13[Count = 1] remaining members to acquire global barrier 2023-09-12 20:59:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:51,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:51,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:51,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-12 20:59:51,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35b18c13[Count = 0] remaining members to acquire global barrier 2023-09-12 20:59:51,966 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-12 20:59:51,966 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,967 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,967 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,967 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,967 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-12 20:59:51,967 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,967 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-12 20:59:51,967 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45939,1694552367290' in zk 2023-09-12 20:59:51,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,967 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-12 20:59:51,967 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-12 20:59:51,968 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,968 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 20:59:51,968 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 20:59:51,968 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 20:59:51,968 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 20:59:51,968 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 20:59:51,968 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 20:59:51,968 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 20:59:51,968 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. started... 2023-09-12 20:59:51,968 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. started... 2023-09-12 20:59:51,968 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1f4ea0d785a433b1fee2257a5b350222: 2023-09-12 20:59:51,969 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd1b3c56d8967053c0d0f19d998271b: 2023-09-12 20:59:51,970 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,970 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,970 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-12 20:59:51,970 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 20:59:51,970 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 20:59:51,970 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 20:59:51,970 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 20:59:51,970 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:51,970 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-12 20:59:51,989 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. completed. 2023-09-12 20:59:51,989 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. completed. 2023-09-12 20:59:51,989 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 20:59:51,989 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 20:59:51,989 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 20:59:51,989 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 20:59:51,990 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,989 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 20:59:51,990 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 20:59:51,990 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,990 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-12 20:59:51,990 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-12 20:59:51,990 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,34031,1694552367245' in zk 2023-09-12 20:59:51,990 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,42813,1694552367323' in zk 2023-09-12 20:59:51,992 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-12 20:59:51,992 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:51,992 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,992 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-12 20:59:51,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:51,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:51,993 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,993 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-12 20:59:51,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:51,993 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:51,993 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-12 20:59:51,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:51,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:51,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:51,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:51,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:51,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,42813,1694552367323': 2023-09-12 20:59:51,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-12 20:59:51,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:51,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:51,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:51,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:51,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:51,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:51,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:52,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,34031,1694552367245': 2023-09-12 20:59:52,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-12 20:59:52,003 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-12 20:59:52,003 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 20:59:52,003 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 20:59:52,003 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,003 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 20:59:52,005 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,005 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,005 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:52,005 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:52,005 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:52,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:52,005 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,005 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:52,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:52,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:52,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:52,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:52,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:52,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,006 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,007 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:52,008 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:52,009 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,010 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,010 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,013 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,013 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,013 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,013 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,013 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:52,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:52,013 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:52,013 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,013 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:52,014 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:52,014 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-12 20:59:52,013 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:52,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:52,014 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:52,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:52,014 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:52,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:52,014 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:52,014 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:52,015 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,015 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,016 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,014 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:52,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 20:59:52,016 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:52,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:52,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:52,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-12 20:59:52,025 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 20:59:52,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 20:59:52,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-12 20:59:52,026 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 20:59:52,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,048 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-12 20:59:52,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,048 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-12 20:59:52,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694552391924Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694552392027 (+103 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1694552392027Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1694552392027Writing data manifest for emptySnaptb0-testExportFileSystemState at 1694552392031 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1694552392040 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694552392048 (+8 ms) 2023-09-12 20:59:52,050 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-12 20:59:52,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 127 msec 2023-09-12 20:59:52,226 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 20:59:52,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 20:59:52,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 20:59:52,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42813] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 20:59:52,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34031] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 20:59:52,236 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-12 20:59:52,236 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 20:59:52,236 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 20:59:52,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 20:59:52,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694552392247 (current time:1694552392247). 2023-09-12 20:59:52,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 20:59:52,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x0594e4f2 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 20:59:52,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@741c8bb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 20:59:52,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:52,258 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:52,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0594e4f2 to 127.0.0.1:58083 2023-09-12 20:59:52,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 20:59:52,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x7c24a37b to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 20:59:52,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e646a5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 20:59:52,267 DEBUG [hconnection-0x62efa892-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:52,268 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:52,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 20:59:52,273 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 20:59:52,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c24a37b to 127.0.0.1:58083 2023-09-12 20:59:52,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 20:59:52,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-12 20:59:52,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 20:59:52,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 20:59:52,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-12 20:59:52,279 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-12 20:59:52,280 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694552992280 2023-09-12 20:59:52,280 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-12 20:59:52,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 20:59:52,281 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 20:59:52,281 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 20:59:52,282 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-12 20:59:52,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-12 20:59:52,284 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-12 20:59:52,284 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-12 20:59:52,285 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694552992285 2023-09-12 20:59:52,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-12 20:59:52,303 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-12 20:59:52,303 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:52,305 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-12 20:59:52,305 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-12 20:59:52,305 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,305 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,306 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:52,306 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:52,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:52,306 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:52,306 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:52,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:52,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:52,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:52,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,307 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,307 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:52,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,307 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,307 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 20:59:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-12 20:59:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,308 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-12 20:59:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-12 20:59:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,308 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-12 20:59:52,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-12 20:59:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-12 20:59:52,308 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-12 20:59:52,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-12 20:59:52,308 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:52,309 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-12 20:59:52,310 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-12 20:59:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,310 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-12 20:59:52,310 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:52,310 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-12 20:59:52,310 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-12 20:59:52,311 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-12 20:59:52,311 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-12 20:59:52,310 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-12 20:59:52,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-12 20:59:52,311 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-12 20:59:52,311 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 20:59:52,312 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-12 20:59:52,312 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-12 20:59:52,312 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-12 20:59:52,315 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,315 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:52,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:52,315 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,316 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,316 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 20:59:52,317 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,317 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:52,317 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 20:59:52,317 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:52,317 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,317 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 20:59:52,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 20:59:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:52,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-12 20:59:52,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@358f3614[Count = 1] remaining members to acquire global barrier 2023-09-12 20:59:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:52,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 20:59:52,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:52,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-12 20:59:52,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@358f3614[Count = 0] remaining members to acquire global barrier 2023-09-12 20:59:52,321 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-12 20:59:52,321 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,322 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,322 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,322 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,322 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-12 20:59:52,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,323 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,323 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-12 20:59:52,323 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 20:59:52,323 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 20:59:52,323 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. started... 2023-09-12 20:59:52,323 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-12 20:59:52,323 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 20:59:52,323 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. started... 2023-09-12 20:59:52,323 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 20:59:52,323 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,323 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 20:59:52,323 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8fd1b3c56d8967053c0d0f19d998271b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-12 20:59:52,323 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 20:59:52,323 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 20:59:52,323 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1f4ea0d785a433b1fee2257a5b350222 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-12 20:59:52,323 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-12 20:59:52,323 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45939,1694552367290' in zk 2023-09-12 20:59:52,325 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-12 20:59:52,325 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:52,325 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-12 20:59:52,370 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309129a2f5e728ae24d0f98f72df6ea3abe20 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309129a2f5e728ae24d0f98f72df6ea3abe20 2023-09-12 20:59:52,379 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091235095c6e4d07469b942ca7781ee82164 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091235095c6e4d07469b942ca7781ee82164 2023-09-12 20:59:52,381 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 20:59:52,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 20:59:52,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-12 20:59:52,382 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 20:59:52,392 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/.tmp/cf/8f935f118fff49c982681daebc0deeae 2023-09-12 20:59:52,399 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/.tmp/cf/8f935f118fff49c982681daebc0deeae as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/cf/8f935f118fff49c982681daebc0deeae 2023-09-12 20:59:52,406 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/cf/8f935f118fff49c982681daebc0deeae, entries=4, sequenceid=6, filesize=5.6 K 2023-09-12 20:59:52,407 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 1f4ea0d785a433b1fee2257a5b350222 in 84ms, sequenceid=6, compaction requested=false 2023-09-12 20:59:52,407 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-12 20:59:52,407 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1f4ea0d785a433b1fee2257a5b350222: 2023-09-12 20:59:52,408 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-12 20:59:52,408 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 20:59:52,408 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/cf/8f935f118fff49c982681daebc0deeae] hfiles 2023-09-12 20:59:52,408 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/cf/8f935f118fff49c982681daebc0deeae for snapshot=snaptb0-testExportFileSystemState 2023-09-12 20:59:52,418 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/.tmp/cf/e0bf1370cbc34cfa9aacd91750a6d39b 2023-09-12 20:59:52,427 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/.tmp/cf/e0bf1370cbc34cfa9aacd91750a6d39b as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/cf/e0bf1370cbc34cfa9aacd91750a6d39b 2023-09-12 20:59:52,432 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/cf/e0bf1370cbc34cfa9aacd91750a6d39b, entries=46, sequenceid=6, filesize=12.7 K 2023-09-12 20:59:52,434 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 8fd1b3c56d8967053c0d0f19d998271b in 110ms, sequenceid=6, compaction requested=false 2023-09-12 20:59:52,438 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd1b3c56d8967053c0d0f19d998271b: 2023-09-12 20:59:52,438 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-12 20:59:52,438 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 20:59:52,438 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/cf/e0bf1370cbc34cfa9aacd91750a6d39b] hfiles 2023-09-12 20:59:52,438 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/cf/e0bf1370cbc34cfa9aacd91750a6d39b for snapshot=snaptb0-testExportFileSystemState 2023-09-12 20:59:52,445 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. completed. 2023-09-12 20:59:52,445 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 20:59:52,445 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 20:59:52,445 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 20:59:52,445 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,448 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-12 20:59:52,448 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,42813,1694552367323' in zk 2023-09-12 20:59:52,455 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-12 20:59:52,455 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,455 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:52,455 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-12 20:59:52,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:52,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 20:59:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,459 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. completed. 2023-09-12 20:59:52,459 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 20:59:52,459 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 20:59:52,459 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 20:59:52,459 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,459 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-12 20:59:52,459 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,34031,1694552367245' in zk 2023-09-12 20:59:52,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,461 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:52,461 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-12 20:59:52,461 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:52,461 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-12 20:59:52,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 20:59:52,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,42813,1694552367323': 2023-09-12 20:59:52,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-12 20:59:52,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:52,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:52,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:52,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:52,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 20:59:52,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:52,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 20:59:52,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,34031,1694552367245': 2023-09-12 20:59:52,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-12 20:59:52,470 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-12 20:59:52,470 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 20:59:52,470 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 20:59:52,470 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-12 20:59:52,470 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 20:59:52,472 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,472 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,472 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 20:59:52,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 20:59:52,472 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:52,472 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,472 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:52,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 20:59:52,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,472 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:52,473 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:52,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:52,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:52,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:52,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:52,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:52,473 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 20:59:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,474 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 20:59:52,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 20:59:52,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,476 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 20:59:52,476 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 20:59:52,476 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,480 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:52,480 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,480 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:52,480 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:52,480 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 20:59:52,480 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:52,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:52,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:52,480 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 20:59:52,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:52,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 20:59:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 20:59:52,481 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:52,481 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:52,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 20:59:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 20:59:52,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 20:59:52,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 20:59:52,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 20:59:52,482 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 20:59:52,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,482 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-12 20:59:52,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,484 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-12 20:59:52,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-12 20:59:52,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 20:59:52,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091235095c6e4d07469b942ca7781ee82164, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309129a2f5e728ae24d0f98f72df6ea3abe20] mob files 2023-09-12 20:59:52,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091235095c6e4d07469b942ca7781ee82164 2023-09-12 20:59:52,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309129a2f5e728ae24d0f98f72df6ea3abe20 2023-09-12 20:59:52,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-12 20:59:52,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,535 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-12 20:59:52,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,535 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694552392280Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694552392505 (+225 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1694552392505Loading Region manifests for snaptb0-testExportFileSystemState at 1694552392505Writing data manifest for snaptb0-testExportFileSystemState at 1694552392510 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1694552392525 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694552392535 (+10 ms) 2023-09-12 20:59:52,539 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-12 20:59:52,541 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 258 msec 2023-09-12 20:59:52,583 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 20:59:52,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 20:59:52,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 20:59:52,584 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552392584 2023-09-12 20:59:52,584 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38861, tgtDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552392584, rawTgtDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552392584, srcFsUri=hdfs://localhost:38861, srcDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 20:59:52,608 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 20:59:52,608 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-613021850_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552392584, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552392584/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,608 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944, snapshotDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-12 20:59:52,629 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552392584/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-12 20:59:52,667 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:52,667 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:52,668 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:52,668 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:53,529 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-5311588833447953918.jar 2023-09-12 20:59:53,529 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:53,530 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:53,595 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-1951185643321938025.jar 2023-09-12 20:59:53,595 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:53,595 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:53,596 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:53,596 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:53,597 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:53,597 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 20:59:53,597 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 20:59:53,598 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 20:59:53,598 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 20:59:53,598 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 20:59:53,599 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 20:59:53,599 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 20:59:53,600 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 20:59:53,600 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 20:59:53,600 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 20:59:53,601 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 20:59:53,602 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 20:59:53,602 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 20:59:53,603 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 20:59:53,603 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 20:59:53,603 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 20:59:53,604 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 20:59:53,604 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 20:59:54,465 WARN [Listener at jenkins-hbase9.apache.org/32837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 20:59:54,467 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-12 20:59:54,470 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-12 20:59:54,881 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 20:59:54,882 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 20:59:54,887 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0001_000001 (auth:SIMPLE) 2023-09-12 20:59:55,627 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0002_000001 (auth:SIMPLE) 2023-09-12 20:59:56,529 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 20:59:59,557 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0002_000001 (auth:SIMPLE) 2023-09-12 21:00:01,813 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0002_000001 (auth:SIMPLE) 2023-09-12 21:00:04,456 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0002_000001 (auth:SIMPLE) 2023-09-12 21:00:05,785 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 21:00:05,786 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 21:00:05,794 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-12 21:00:05,794 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 21:00:05,795 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 21:00:05,795 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-480281790_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-12 21:00:05,795 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-12 21:00:05,796 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-12 21:00:05,796 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-480281790_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552392584/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552392584/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-12 21:00:05,796 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552392584/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-12 21:00:05,796 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552392584/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-12 21:00:05,803 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-12 21:00:05,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-09-12 21:00:05,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-12 21:00:05,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-12 21:00:05,808 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552405808"}]},"ts":"1694552405808"} 2023-09-12 21:00:05,810 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-12 21:00:05,812 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-12 21:00:05,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1f4ea0d785a433b1fee2257a5b350222, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd1b3c56d8967053c0d0f19d998271b, UNASSIGN}] 2023-09-12 21:00:05,815 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1f4ea0d785a433b1fee2257a5b350222, UNASSIGN 2023-09-12 21:00:05,815 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd1b3c56d8967053c0d0f19d998271b, UNASSIGN 2023-09-12 21:00:05,816 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1f4ea0d785a433b1fee2257a5b350222, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:05,816 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8fd1b3c56d8967053c0d0f19d998271b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:05,816 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694552405816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552405816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552405816"}]},"ts":"1694552405816"} 2023-09-12 21:00:05,816 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694552405816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552405816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552405816"}]},"ts":"1694552405816"} 2023-09-12 21:00:05,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 8fd1b3c56d8967053c0d0f19d998271b, server=jenkins-hbase9.apache.org,34031,1694552367245}] 2023-09-12 21:00:05,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 1f4ea0d785a433b1fee2257a5b350222, server=jenkins-hbase9.apache.org,42813,1694552367323}] 2023-09-12 21:00:05,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-12 21:00:05,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8fd1b3c56d8967053c0d0f19d998271b 2023-09-12 21:00:05,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8fd1b3c56d8967053c0d0f19d998271b, disabling compactions & flushes 2023-09-12 21:00:05,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 21:00:05,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 21:00:05,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 1f4ea0d785a433b1fee2257a5b350222 2023-09-12 21:00:05,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. after waiting 0 ms 2023-09-12 21:00:05,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 21:00:05,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1f4ea0d785a433b1fee2257a5b350222, disabling compactions & flushes 2023-09-12 21:00:05,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 21:00:05,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 21:00:05,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. after waiting 0 ms 2023-09-12 21:00:05,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 21:00:05,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 21:00:05,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 21:00:05,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:00:05,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:00:05,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222. 2023-09-12 21:00:05,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b. 2023-09-12 21:00:05,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1f4ea0d785a433b1fee2257a5b350222: 2023-09-12 21:00:05,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8fd1b3c56d8967053c0d0f19d998271b: 2023-09-12 21:00:05,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8fd1b3c56d8967053c0d0f19d998271b 2023-09-12 21:00:05,984 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8fd1b3c56d8967053c0d0f19d998271b, regionState=CLOSED 2023-09-12 21:00:05,985 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694552405984"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552405984"}]},"ts":"1694552405984"} 2023-09-12 21:00:05,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 1f4ea0d785a433b1fee2257a5b350222 2023-09-12 21:00:05,985 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1f4ea0d785a433b1fee2257a5b350222, regionState=CLOSED 2023-09-12 21:00:05,986 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694552405985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552405985"}]},"ts":"1694552405985"} 2023-09-12 21:00:05,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-12 21:00:05,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 8fd1b3c56d8967053c0d0f19d998271b, server=jenkins-hbase9.apache.org,34031,1694552367245 in 168 msec 2023-09-12 21:00:05,989 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-12 21:00:05,989 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 1f4ea0d785a433b1fee2257a5b350222, server=jenkins-hbase9.apache.org,42813,1694552367323 in 169 msec 2023-09-12 21:00:05,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd1b3c56d8967053c0d0f19d998271b, UNASSIGN in 176 msec 2023-09-12 21:00:05,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-12 21:00:05,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1f4ea0d785a433b1fee2257a5b350222, UNASSIGN in 176 msec 2023-09-12 21:00:05,993 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552405992"}]},"ts":"1694552405992"} 2023-09-12 21:00:05,994 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-12 21:00:05,996 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-12 21:00:05,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 193 msec 2023-09-12 21:00:06,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-12 21:00:06,110 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-12 21:00:06,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-09-12 21:00:06,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-12 21:00:06,115 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-12 21:00:06,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-12 21:00:06,116 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-12 21:00:06,117 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-12 21:00:06,120 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 21:00:06,120 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 21:00:06,120 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 21:00:06,120 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 21:00:06,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-12 21:00:06,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-12 21:00:06,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-12 21:00:06,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-12 21:00:06,121 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222 2023-09-12 21:00:06,121 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b 2023-09-12 21:00:06,123 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 21:00:06,123 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:06,123 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 21:00:06,123 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 21:00:06,123 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 21:00:06,123 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:06,123 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:06,123 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:06,124 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/recovered.edits] 2023-09-12 21:00:06,124 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/recovered.edits] 2023-09-12 21:00:06,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-12 21:00:06,128 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/cf/8f935f118fff49c982681daebc0deeae to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/cf/8f935f118fff49c982681daebc0deeae 2023-09-12 21:00:06,129 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/cf/e0bf1370cbc34cfa9aacd91750a6d39b to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/cf/e0bf1370cbc34cfa9aacd91750a6d39b 2023-09-12 21:00:06,132 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/recovered.edits/9.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222/recovered.edits/9.seqid 2023-09-12 21:00:06,132 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/recovered.edits/9.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b/recovered.edits/9.seqid 2023-09-12 21:00:06,132 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/1f4ea0d785a433b1fee2257a5b350222 2023-09-12 21:00:06,133 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemState/8fd1b3c56d8967053c0d0f19d998271b 2023-09-12 21:00:06,133 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-12 21:00:06,133 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-12 21:00:06,134 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-12 21:00:06,138 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091235095c6e4d07469b942ca7781ee82164 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091235095c6e4d07469b942ca7781ee82164 2023-09-12 21:00:06,139 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309129a2f5e728ae24d0f98f72df6ea3abe20 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309129a2f5e728ae24d0f98f72df6ea3abe20 2023-09-12 21:00:06,140 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-12 21:00:06,143 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-12 21:00:06,145 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-12 21:00:06,148 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-12 21:00:06,149 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-12 21:00:06,149 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-12 21:00:06,149 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694552406149"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:06,150 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694552406149"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:06,152 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-12 21:00:06,152 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1f4ea0d785a433b1fee2257a5b350222, NAME => 'testtb-testExportFileSystemState,,1694552391252.1f4ea0d785a433b1fee2257a5b350222.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8fd1b3c56d8967053c0d0f19d998271b, NAME => 'testtb-testExportFileSystemState,1,1694552391252.8fd1b3c56d8967053c0d0f19d998271b.', STARTKEY => '1', ENDKEY => ''}] 2023-09-12 21:00:06,152 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-12 21:00:06,152 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694552406152"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:06,154 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-12 21:00:06,156 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-12 21:00:06,158 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 45 msec 2023-09-12 21:00:06,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-12 21:00:06,226 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-12 21:00:06,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-12 21:00:06,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-12 21:00:06,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-09-12 21:00:06,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-12 21:00:06,267 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=768 (was 753) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (640167340) connection to jenkins-hbase9.apache.org/172.31.2.10:32837 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1964 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:54154 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_56832569_1 at /127.0.0.1:51860 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (640167340) connection to jenkins-hbase9.apache.org/172.31.2.10:43043 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:46816 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:51890 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_56832569_1 at /127.0.0.1:54130 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 926) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=284 (was 221) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=5953 (was 6111) 2023-09-12 21:00:06,267 WARN [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-09-12 21:00:06,288 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=284, ProcessCount=171, AvailableMemoryMB=5952 2023-09-12 21:00:06,288 WARN [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-09-12 21:00:06,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-12 21:00:06,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-12 21:00:06,294 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 21:00:06,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-12 21:00:06,295 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 21:00:06,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-12 21:00:06,298 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55 2023-09-12 21:00:06,298 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60 2023-09-12 21:00:06,299 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55 empty. 2023-09-12 21:00:06,299 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60 empty. 2023-09-12 21:00:06,299 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60 2023-09-12 21:00:06,299 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55 2023-09-12 21:00:06,299 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-12 21:00:06,317 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-12 21:00:06,318 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => a9f11e9ce2bef58e1010f2e0dd60ef55, NAME => 'testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 21:00:06,318 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 510195b7e534bbec1b4290f3a2a16f60, NAME => 'testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 21:00:06,349 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:06,349 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing a9f11e9ce2bef58e1010f2e0dd60ef55, disabling compactions & flushes 2023-09-12 21:00:06,349 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:06,349 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:06,349 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. after waiting 0 ms 2023-09-12 21:00:06,349 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:06,349 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:06,349 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for a9f11e9ce2bef58e1010f2e0dd60ef55: 2023-09-12 21:00:06,361 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:06,361 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 510195b7e534bbec1b4290f3a2a16f60, disabling compactions & flushes 2023-09-12 21:00:06,361 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:06,361 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:06,361 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. after waiting 0 ms 2023-09-12 21:00:06,361 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:06,361 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:06,361 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 510195b7e534bbec1b4290f3a2a16f60: 2023-09-12 21:00:06,364 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 21:00:06,365 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694552406365"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552406365"}]},"ts":"1694552406365"} 2023-09-12 21:00:06,365 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694552406365"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552406365"}]},"ts":"1694552406365"} 2023-09-12 21:00:06,368 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 21:00:06,369 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 21:00:06,369 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552406369"}]},"ts":"1694552406369"} 2023-09-12 21:00:06,371 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-12 21:00:06,375 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-12 21:00:06,376 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 21:00:06,376 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 21:00:06,376 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 21:00:06,376 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 21:00:06,376 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a9f11e9ce2bef58e1010f2e0dd60ef55, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=510195b7e534bbec1b4290f3a2a16f60, ASSIGN}] 2023-09-12 21:00:06,379 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a9f11e9ce2bef58e1010f2e0dd60ef55, ASSIGN 2023-09-12 21:00:06,379 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=510195b7e534bbec1b4290f3a2a16f60, ASSIGN 2023-09-12 21:00:06,380 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a9f11e9ce2bef58e1010f2e0dd60ef55, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34031,1694552367245; forceNewPlan=false, retain=false 2023-09-12 21:00:06,381 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=510195b7e534bbec1b4290f3a2a16f60, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42813,1694552367323; forceNewPlan=false, retain=false 2023-09-12 21:00:06,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-12 21:00:06,531 INFO [jenkins-hbase9:38453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 21:00:06,534 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=510195b7e534bbec1b4290f3a2a16f60, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:06,534 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a9f11e9ce2bef58e1010f2e0dd60ef55, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:06,534 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694552406534"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552406534"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552406534"}]},"ts":"1694552406534"} 2023-09-12 21:00:06,534 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694552406534"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552406534"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552406534"}]},"ts":"1694552406534"} 2023-09-12 21:00:06,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 510195b7e534bbec1b4290f3a2a16f60, server=jenkins-hbase9.apache.org,42813,1694552367323}] 2023-09-12 21:00:06,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure a9f11e9ce2bef58e1010f2e0dd60ef55, server=jenkins-hbase9.apache.org,34031,1694552367245}] 2023-09-12 21:00:06,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-12 21:00:06,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:06,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 510195b7e534bbec1b4290f3a2a16f60, NAME => 'testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60.', STARTKEY => '1', ENDKEY => ''} 2023-09-12 21:00:06,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. service=AccessControlService 2023-09-12 21:00:06,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 21:00:06,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:06,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 510195b7e534bbec1b4290f3a2a16f60 2023-09-12 21:00:06,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a9f11e9ce2bef58e1010f2e0dd60ef55, NAME => 'testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55.', STARTKEY => '', ENDKEY => '1'} 2023-09-12 21:00:06,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:06,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 510195b7e534bbec1b4290f3a2a16f60 2023-09-12 21:00:06,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 510195b7e534bbec1b4290f3a2a16f60 2023-09-12 21:00:06,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. service=AccessControlService 2023-09-12 21:00:06,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 21:00:06,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a9f11e9ce2bef58e1010f2e0dd60ef55 2023-09-12 21:00:06,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:06,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a9f11e9ce2bef58e1010f2e0dd60ef55 2023-09-12 21:00:06,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a9f11e9ce2bef58e1010f2e0dd60ef55 2023-09-12 21:00:06,695 INFO [StoreOpener-510195b7e534bbec1b4290f3a2a16f60-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 510195b7e534bbec1b4290f3a2a16f60 2023-09-12 21:00:06,695 INFO [StoreOpener-a9f11e9ce2bef58e1010f2e0dd60ef55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a9f11e9ce2bef58e1010f2e0dd60ef55 2023-09-12 21:00:06,696 DEBUG [StoreOpener-510195b7e534bbec1b4290f3a2a16f60-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/cf 2023-09-12 21:00:06,696 DEBUG [StoreOpener-510195b7e534bbec1b4290f3a2a16f60-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/cf 2023-09-12 21:00:06,696 DEBUG [StoreOpener-a9f11e9ce2bef58e1010f2e0dd60ef55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/cf 2023-09-12 21:00:06,696 DEBUG [StoreOpener-a9f11e9ce2bef58e1010f2e0dd60ef55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/cf 2023-09-12 21:00:06,696 INFO [StoreOpener-510195b7e534bbec1b4290f3a2a16f60-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 510195b7e534bbec1b4290f3a2a16f60 columnFamilyName cf 2023-09-12 21:00:06,697 INFO [StoreOpener-a9f11e9ce2bef58e1010f2e0dd60ef55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9f11e9ce2bef58e1010f2e0dd60ef55 columnFamilyName cf 2023-09-12 21:00:06,698 INFO [StoreOpener-510195b7e534bbec1b4290f3a2a16f60-1] regionserver.HStore(310): Store=510195b7e534bbec1b4290f3a2a16f60/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 21:00:06,698 INFO [StoreOpener-a9f11e9ce2bef58e1010f2e0dd60ef55-1] regionserver.HStore(310): Store=a9f11e9ce2bef58e1010f2e0dd60ef55/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 21:00:06,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55 2023-09-12 21:00:06,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60 2023-09-12 21:00:06,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55 2023-09-12 21:00:06,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60 2023-09-12 21:00:06,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a9f11e9ce2bef58e1010f2e0dd60ef55 2023-09-12 21:00:06,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 21:00:06,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a9f11e9ce2bef58e1010f2e0dd60ef55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64513406, jitterRate=-0.03867533802986145}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 21:00:06,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a9f11e9ce2bef58e1010f2e0dd60ef55: 2023-09-12 21:00:06,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55., pid=46, masterSystemTime=1694552406690 2023-09-12 21:00:06,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 510195b7e534bbec1b4290f3a2a16f60 2023-09-12 21:00:06,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:06,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:06,708 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a9f11e9ce2bef58e1010f2e0dd60ef55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:06,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 21:00:06,708 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694552406708"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552406708"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552406708"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552406708"}]},"ts":"1694552406708"} 2023-09-12 21:00:06,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 510195b7e534bbec1b4290f3a2a16f60; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62806066, jitterRate=-0.06411668658256531}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 21:00:06,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 510195b7e534bbec1b4290f3a2a16f60: 2023-09-12 21:00:06,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60., pid=45, masterSystemTime=1694552406689 2023-09-12 21:00:06,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:06,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:06,712 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=510195b7e534bbec1b4290f3a2a16f60, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:06,712 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694552406712"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552406712"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552406712"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552406712"}]},"ts":"1694552406712"} 2023-09-12 21:00:06,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-12 21:00:06,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure a9f11e9ce2bef58e1010f2e0dd60ef55, server=jenkins-hbase9.apache.org,34031,1694552367245 in 173 msec 2023-09-12 21:00:06,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a9f11e9ce2bef58e1010f2e0dd60ef55, ASSIGN in 337 msec 2023-09-12 21:00:06,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-12 21:00:06,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 510195b7e534bbec1b4290f3a2a16f60, server=jenkins-hbase9.apache.org,42813,1694552367323 in 178 msec 2023-09-12 21:00:06,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-12 21:00:06,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=510195b7e534bbec1b4290f3a2a16f60, ASSIGN in 339 msec 2023-09-12 21:00:06,718 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 21:00:06,718 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552406718"}]},"ts":"1694552406718"} 2023-09-12 21:00:06,719 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-12 21:00:06,723 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 21:00:06,723 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-12 21:00:06,725 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-12 21:00:06,726 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:06,726 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:06,726 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:06,726 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:06,728 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:06,728 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:06,728 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:06,728 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:06,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 438 msec 2023-09-12 21:00:06,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-12 21:00:06,899 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-12 21:00:06,901 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-12 21:00:06,901 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:06,903 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 21:00:06,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-12 21:00:06,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694552406914 (current time:1694552406914). 2023-09-12 21:00:06,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 21:00:06,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x038776b4 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:06,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17d6bb4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:06,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:06,926 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:06,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x038776b4 to 127.0.0.1:58083 2023-09-12 21:00:06,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:06,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x0f9055bd to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:06,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@371aa02d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:06,937 DEBUG [hconnection-0x5d504db1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:06,939 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:06,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:06,946 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:06,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f9055bd to 127.0.0.1:58083 2023-09-12 21:00:06,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:06,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-12 21:00:06,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 21:00:06,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-12 21:00:06,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-12 21:00:06,951 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-12 21:00:06,952 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694553006952 2023-09-12 21:00:06,952 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-12 21:00:06,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-12 21:00:06,953 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 21:00:06,953 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 21:00:06,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-12 21:00:06,956 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-12 21:00:06,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-12 21:00:06,958 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-12 21:00:06,959 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694553006959 2023-09-12 21:00:06,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,971 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-12 21:00:06,971 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:06,972 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-12 21:00:06,972 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-12 21:00:06,972 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,972 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,973 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:06,973 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:06,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:06,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:06,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:06,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:06,973 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:06,973 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:06,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:06,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:06,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,974 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:06,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,974 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:06,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,974 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:06,975 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 21:00:06,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-12 21:00:06,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-12 21:00:06,975 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-12 21:00:06,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-12 21:00:06,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,975 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-12 21:00:06,975 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-12 21:00:06,975 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-12 21:00:06,975 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:06,976 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-12 21:00:06,976 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,976 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-12 21:00:06,976 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-12 21:00:06,976 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,976 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-12 21:00:06,976 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:06,976 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-12 21:00:06,977 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:06,980 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-12 21:00:06,980 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-12 21:00:06,980 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-12 21:00:06,980 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-12 21:00:06,980 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-12 21:00:06,980 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-12 21:00:06,983 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,984 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:06,984 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:06,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:06,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:06,985 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:06,985 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,985 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:06,985 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,985 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:06,985 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:06,985 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,985 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:06,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:06,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:06,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:06,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:06,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:06,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-12 21:00:06,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c83cd14[Count = 1] remaining members to acquire global barrier 2023-09-12 21:00:06,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:06,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:06,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:06,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:06,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:06,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:06,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:06,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:06,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:06,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-12 21:00:06,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c83cd14[Count = 0] remaining members to acquire global barrier 2023-09-12 21:00:06,989 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-12 21:00:06,989 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,990 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,990 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,990 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,990 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:06,990 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-12 21:00:06,990 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-12 21:00:06,990 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-12 21:00:06,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,990 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:00:06,990 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:06,990 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,45939,1694552367290' in zk 2023-09-12 21:00:06,990 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:06,991 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 21:00:06,990 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. started... 2023-09-12 21:00:06,990 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:00:06,990 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-12 21:00:06,991 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a9f11e9ce2bef58e1010f2e0dd60ef55: 2023-09-12 21:00:06,991 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:06,991 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:00:06,991 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:00:06,991 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. started... 2023-09-12 21:00:06,991 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,991 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:00:06,992 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 21:00:06,992 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 510195b7e534bbec1b4290f3a2a16f60: 2023-09-12 21:00:06,992 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:06,993 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:00:06,993 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 21:00:07,000 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-12 21:00:07,000 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:07,000 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-12 21:00:07,010 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. completed. 2023-09-12 21:00:07,010 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:07,010 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:00:07,010 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:00:07,010 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,010 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-12 21:00:07,010 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,42813,1694552367323' in zk 2023-09-12 21:00:07,011 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. completed. 2023-09-12 21:00:07,011 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:07,011 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:00:07,011 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:00:07,011 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,011 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-12 21:00:07,011 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,34031,1694552367245' in zk 2023-09-12 21:00:07,012 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-12 21:00:07,012 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,012 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:07,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:07,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:07,012 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-12 21:00:07,014 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,014 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-12 21:00:07,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:07,014 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:07,014 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-12 21:00:07,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:07,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:07,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,42813,1694552367323': 2023-09-12 21:00:07,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-12 21:00:07,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:07,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:07,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:07,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:07,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:07,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,34031,1694552367245': 2023-09-12 21:00:07,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-12 21:00:07,021 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-12 21:00:07,021 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 21:00:07,021 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 21:00:07,021 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,021 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 21:00:07,023 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,023 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,023 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,023 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:07,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,023 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:07,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,023 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:07,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,023 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,023 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:07,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:07,026 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:07,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:07,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:07,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:07,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,027 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:07,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,029 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:07,030 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,030 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,034 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:07,034 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:07,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:07,034 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:07,034 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:07,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:07,034 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:07,034 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,034 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:07,034 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:07,034 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,034 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:07,034 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-12 21:00:07,034 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,035 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 21:00:07,035 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:07,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:07,036 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:07,036 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,036 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,036 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-12 21:00:07,036 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,036 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,054 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:00:07,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-12 21:00:07,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-12 21:00:07,055 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 21:00:07,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,071 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-12 21:00:07,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,071 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:07,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694552406952Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694552407043 (+91 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1694552407043Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1694552407043Writing data manifest for emptySnaptb0-testConsecutiveExports at 1694552407049 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1694552407065 (+16 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694552407071 (+6 ms) 2023-09-12 21:00:07,074 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-12 21:00:07,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 121 msec 2023-09-12 21:00:07,255 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:00:07,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-12 21:00:07,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 21:00:07,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34031] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 21:00:07,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42813] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 21:00:07,263 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-12 21:00:07,263 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:07,263 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 21:00:07,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-12 21:00:07,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694552407275 (current time:1694552407275). 2023-09-12 21:00:07,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 21:00:07,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x092c45f2 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:07,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c40f257, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:07,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:07,289 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:07,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x092c45f2 to 127.0.0.1:58083 2023-09-12 21:00:07,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:07,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x4473772e to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:07,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f1ba987, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:07,306 DEBUG [hconnection-0x24423479-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:07,308 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:07,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:07,313 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:07,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4473772e to 127.0.0.1:58083 2023-09-12 21:00:07,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:07,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-12 21:00:07,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 21:00:07,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-12 21:00:07,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-12 21:00:07,318 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-12 21:00:07,319 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694553007319 2023-09-12 21:00:07,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-12 21:00:07,319 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-12 21:00:07,320 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 21:00:07,320 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 21:00:07,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-12 21:00:07,321 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-12 21:00:07,323 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-12 21:00:07,324 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-12 21:00:07,324 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694553007324 2023-09-12 21:00:07,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-12 21:00:07,334 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-12 21:00:07,334 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:07,335 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-12 21:00:07,335 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-12 21:00:07,336 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,336 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,337 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,337 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:07,337 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:07,338 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:07,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:07,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:07,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:07,338 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,338 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,339 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,339 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 21:00:07,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-12 21:00:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-12 21:00:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,340 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-12 21:00:07,340 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-12 21:00:07,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-12 21:00:07,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-12 21:00:07,340 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-12 21:00:07,340 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-12 21:00:07,340 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-12 21:00:07,340 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:07,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,341 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-12 21:00:07,342 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-12 21:00:07,342 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-12 21:00:07,342 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-12 21:00:07,342 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-12 21:00:07,343 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-12 21:00:07,343 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-12 21:00:07,344 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,345 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,345 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,345 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:07,345 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:07,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:07,346 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,346 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:07,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:07,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:07,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 21:00:07,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:07,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-12 21:00:07,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b939385[Count = 1] remaining members to acquire global barrier 2023-09-12 21:00:07,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-12 21:00:07,353 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-12 21:00:07,353 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:07,354 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-12 21:00:07,354 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-12 21:00:07,354 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-12 21:00:07,357 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,357 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:07,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:07,357 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,357 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:07,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:07,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:07,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 21:00:07,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:07,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-12 21:00:07,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b939385[Count = 0] remaining members to acquire global barrier 2023-09-12 21:00:07,359 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-12 21:00:07,359 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,360 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,360 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,361 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-12 21:00:07,360 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,361 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,361 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-12 21:00:07,361 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-12 21:00:07,361 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:00:07,361 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:00:07,361 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,45939,1694552367290' in zk 2023-09-12 21:00:07,361 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-12 21:00:07,361 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:07,361 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,361 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. started... 2023-09-12 21:00:07,361 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:00:07,361 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:07,361 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 21:00:07,362 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. started... 2023-09-12 21:00:07,362 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 510195b7e534bbec1b4290f3a2a16f60 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-12 21:00:07,361 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:00:07,362 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a9f11e9ce2bef58e1010f2e0dd60ef55 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-12 21:00:07,363 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-12 21:00:07,363 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:07,363 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-12 21:00:07,401 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091255363de818564baabb6ba5fef975b71b to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091255363de818564baabb6ba5fef975b71b 2023-09-12 21:00:07,404 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230912f5d3eefccd8444738995e06173bd0adb to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230912f5d3eefccd8444738995e06173bd0adb 2023-09-12 21:00:07,415 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/.tmp/cf/7c3d17c76601472286d8a8dcc439d6e7 2023-09-12 21:00:07,416 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/.tmp/cf/7367c1dd2ce44f6e9eb355acaa7a840c 2023-09-12 21:00:07,420 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:00:07,421 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/.tmp/cf/7c3d17c76601472286d8a8dcc439d6e7 as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/cf/7c3d17c76601472286d8a8dcc439d6e7 2023-09-12 21:00:07,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-12 21:00:07,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-12 21:00:07,422 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 21:00:07,422 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/.tmp/cf/7367c1dd2ce44f6e9eb355acaa7a840c as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/cf/7367c1dd2ce44f6e9eb355acaa7a840c 2023-09-12 21:00:07,428 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/cf/7c3d17c76601472286d8a8dcc439d6e7, entries=1, sequenceid=6, filesize=5.1 K 2023-09-12 21:00:07,429 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/cf/7367c1dd2ce44f6e9eb355acaa7a840c, entries=49, sequenceid=6, filesize=13.0 K 2023-09-12 21:00:07,429 INFO [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for a9f11e9ce2bef58e1010f2e0dd60ef55 in 67ms, sequenceid=6, compaction requested=false 2023-09-12 21:00:07,429 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-12 21:00:07,430 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 510195b7e534bbec1b4290f3a2a16f60 in 68ms, sequenceid=6, compaction requested=false 2023-09-12 21:00:07,430 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-12 21:00:07,430 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a9f11e9ce2bef58e1010f2e0dd60ef55: 2023-09-12 21:00:07,432 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 510195b7e534bbec1b4290f3a2a16f60: 2023-09-12 21:00:07,432 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-12 21:00:07,432 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-12 21:00:07,432 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:00:07,432 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:00:07,432 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/cf/7c3d17c76601472286d8a8dcc439d6e7] hfiles 2023-09-12 21:00:07,432 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/cf/7367c1dd2ce44f6e9eb355acaa7a840c] hfiles 2023-09-12 21:00:07,432 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/cf/7c3d17c76601472286d8a8dcc439d6e7 for snapshot=snaptb0-testConsecutiveExports 2023-09-12 21:00:07,432 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/cf/7367c1dd2ce44f6e9eb355acaa7a840c for snapshot=snaptb0-testConsecutiveExports 2023-09-12 21:00:07,452 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. completed. 2023-09-12 21:00:07,453 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:07,453 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:00:07,453 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:00:07,453 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,453 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-12 21:00:07,453 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,34031,1694552367245' in zk 2023-09-12 21:00:07,455 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,455 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-12 21:00:07,455 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:07,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,455 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-12 21:00:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:07,457 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. completed. 2023-09-12 21:00:07,457 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:07,458 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:00:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:07,458 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:00:07,458 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,458 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-12 21:00:07,458 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,42813,1694552367323' in zk 2023-09-12 21:00:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 21:00:07,460 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-12 21:00:07,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,460 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,460 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:07,460 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-12 21:00:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 21:00:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,34031,1694552367245': 2023-09-12 21:00:07,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-12 21:00:07,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:07,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:07,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:07,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:07,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 21:00:07,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:07,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 21:00:07,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,42813,1694552367323': 2023-09-12 21:00:07,469 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-12 21:00:07,469 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-12 21:00:07,469 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 21:00:07,469 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 21:00:07,469 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-12 21:00:07,469 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 21:00:07,471 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,471 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,471 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:07,471 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,471 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,471 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:07,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:07,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:07,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:07,471 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:07,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:07,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:07,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:07,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:07,472 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:07,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:07,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,472 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 21:00:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,473 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 21:00:07,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,475 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:07,475 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 21:00:07,475 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,481 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,481 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:07,481 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,481 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:07,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:07,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:07,481 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:07,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:07,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:07,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:07,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:07,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:07,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:07,482 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:07,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:07,482 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-12 21:00:07,484 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-12 21:00:07,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-12 21:00:07,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:07,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:07,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 21:00:07,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:07,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:07,482 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:07,485 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:07,485 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,485 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:07,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230912f5d3eefccd8444738995e06173bd0adb, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091255363de818564baabb6ba5fef975b71b] mob files 2023-09-12 21:00:07,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230912f5d3eefccd8444738995e06173bd0adb 2023-09-12 21:00:07,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091255363de818564baabb6ba5fef975b71b 2023-09-12 21:00:07,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:07,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:07,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-12 21:00:07,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,524 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-12 21:00:07,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,525 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694552407319Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694552407499 (+180 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1694552407499Loading Region manifests for snaptb0-testConsecutiveExports at 1694552407499Writing data manifest for snaptb0-testConsecutiveExports at 1694552407503 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1694552407514 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694552407524 (+10 ms) 2023-09-12 21:00:07,527 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-12 21:00:07,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 207 msec 2023-09-12 21:00:07,622 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:00:07,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-12 21:00:07,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 21:00:07,624 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624 2023-09-12 21:00:07,624 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624, srcFsUri=hdfs://localhost:38861, srcDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 21:00:07,654 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 21:00:07,654 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@36be778e, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,654 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944, snapshotDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-12 21:00:07,663 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 21:00:07,675 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:07,675 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:07,676 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:07,676 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:08,526 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-504244843122747745.jar 2023-09-12 21:00:08,527 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:08,527 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:08,592 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-861396299394299451.jar 2023-09-12 21:00:08,592 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:08,592 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:08,593 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:08,593 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:08,594 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:08,594 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:08,594 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 21:00:08,595 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 21:00:08,595 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 21:00:08,595 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 21:00:08,596 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 21:00:08,596 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 21:00:08,596 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 21:00:08,597 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 21:00:08,597 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 21:00:08,598 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 21:00:08,598 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:08,598 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:08,599 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:00:08,599 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:08,599 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:08,600 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:00:08,600 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:00:08,957 WARN [Listener at jenkins-hbase9.apache.org/32837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 21:00:08,959 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-12 21:00:08,961 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-12 21:00:10,624 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 21:00:10,624 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 21:00:10,626 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0002_000001 (auth:SIMPLE) 2023-09-12 21:00:10,893 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0003_000001 (auth:SIMPLE) 2023-09-12 21:00:11,562 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 21:00:14,379 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0003_000001 (auth:SIMPLE) 2023-09-12 21:00:16,580 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0003_000001 (auth:SIMPLE) 2023-09-12 21:00:19,384 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0003_000001 (auth:SIMPLE) 2023-09-12 21:00:21,120 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 21:00:21,120 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 21:00:21,124 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-12 21:00:21,124 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 21:00:21,125 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 21:00:21,125 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-480281790_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-12 21:00:21,128 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-12 21:00:21,128 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-12 21:00:21,128 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6966d9da in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-12 21:00:21,128 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-12 21:00:21,128 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-12 21:00:21,129 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624, srcFsUri=hdfs://localhost:38861, srcDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 21:00:21,150 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 21:00:21,150 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@59d35569, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 21:00:21,151 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944, snapshotDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-12 21:00:21,161 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 21:00:21,173 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:21,173 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:21,173 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:21,174 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:22,021 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-4964970653023135463.jar 2023-09-12 21:00:22,022 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:22,022 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:22,086 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-2480719840855373556.jar 2023-09-12 21:00:22,087 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:22,087 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:22,087 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:22,088 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:22,088 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:22,088 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:22,089 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 21:00:22,089 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 21:00:22,090 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 21:00:22,090 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 21:00:22,090 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 21:00:22,091 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 21:00:22,091 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 21:00:22,091 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 21:00:22,092 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 21:00:22,092 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 21:00:22,093 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:22,093 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:22,094 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:00:22,094 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:22,094 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:22,095 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:00:22,095 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:00:22,466 WARN [Listener at jenkins-hbase9.apache.org/32837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 21:00:22,468 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-12 21:00:22,470 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-12 21:00:25,552 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 21:00:25,552 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 21:00:25,556 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0003_000001 (auth:SIMPLE) 2023-09-12 21:00:26,366 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0004_000001 (auth:SIMPLE) 2023-09-12 21:00:29,885 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0004_000001 (auth:SIMPLE) 2023-09-12 21:00:32,088 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0004_000001 (auth:SIMPLE) 2023-09-12 21:00:34,220 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0004_000001 (auth:SIMPLE) 2023-09-12 21:00:35,618 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 21:00:35,619 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 21:00:35,621 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-12 21:00:35,622 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 21:00:35,622 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 21:00:35,622 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-480281790_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-12 21:00:35,624 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-12 21:00:35,625 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-12 21:00:35,625 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6966d9da in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-12 21:00:35,625 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-12 21:00:35,625 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/local-export-1694552407624/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-12 21:00:35,637 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-12 21:00:35,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-09-12 21:00:35,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-12 21:00:35,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-12 21:00:35,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552435641"}]},"ts":"1694552435641"} 2023-09-12 21:00:35,643 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-12 21:00:35,645 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-12 21:00:35,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a9f11e9ce2bef58e1010f2e0dd60ef55, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=510195b7e534bbec1b4290f3a2a16f60, UNASSIGN}] 2023-09-12 21:00:35,648 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a9f11e9ce2bef58e1010f2e0dd60ef55, UNASSIGN 2023-09-12 21:00:35,648 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=510195b7e534bbec1b4290f3a2a16f60, UNASSIGN 2023-09-12 21:00:35,648 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=510195b7e534bbec1b4290f3a2a16f60, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:35,648 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a9f11e9ce2bef58e1010f2e0dd60ef55, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:35,649 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694552435648"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552435648"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552435648"}]},"ts":"1694552435648"} 2023-09-12 21:00:35,649 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694552435648"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552435648"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552435648"}]},"ts":"1694552435648"} 2023-09-12 21:00:35,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 510195b7e534bbec1b4290f3a2a16f60, server=jenkins-hbase9.apache.org,42813,1694552367323}] 2023-09-12 21:00:35,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure a9f11e9ce2bef58e1010f2e0dd60ef55, server=jenkins-hbase9.apache.org,34031,1694552367245}] 2023-09-12 21:00:35,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-12 21:00:35,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 510195b7e534bbec1b4290f3a2a16f60 2023-09-12 21:00:35,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 510195b7e534bbec1b4290f3a2a16f60, disabling compactions & flushes 2023-09-12 21:00:35,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:35,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:35,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. after waiting 0 ms 2023-09-12 21:00:35,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:35,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a9f11e9ce2bef58e1010f2e0dd60ef55 2023-09-12 21:00:35,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a9f11e9ce2bef58e1010f2e0dd60ef55, disabling compactions & flushes 2023-09-12 21:00:35,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:35,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:35,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. after waiting 0 ms 2023-09-12 21:00:35,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:35,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 21:00:35,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 21:00:35,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:00:35,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60. 2023-09-12 21:00:35,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 510195b7e534bbec1b4290f3a2a16f60: 2023-09-12 21:00:35,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:00:35,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55. 2023-09-12 21:00:35,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a9f11e9ce2bef58e1010f2e0dd60ef55: 2023-09-12 21:00:35,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 510195b7e534bbec1b4290f3a2a16f60 2023-09-12 21:00:35,817 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=510195b7e534bbec1b4290f3a2a16f60, regionState=CLOSED 2023-09-12 21:00:35,817 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694552435817"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552435817"}]},"ts":"1694552435817"} 2023-09-12 21:00:35,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a9f11e9ce2bef58e1010f2e0dd60ef55 2023-09-12 21:00:35,817 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a9f11e9ce2bef58e1010f2e0dd60ef55, regionState=CLOSED 2023-09-12 21:00:35,818 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694552435817"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552435817"}]},"ts":"1694552435817"} 2023-09-12 21:00:35,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-12 21:00:35,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 510195b7e534bbec1b4290f3a2a16f60, server=jenkins-hbase9.apache.org,42813,1694552367323 in 168 msec 2023-09-12 21:00:35,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-12 21:00:35,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure a9f11e9ce2bef58e1010f2e0dd60ef55, server=jenkins-hbase9.apache.org,34031,1694552367245 in 168 msec 2023-09-12 21:00:35,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=510195b7e534bbec1b4290f3a2a16f60, UNASSIGN in 174 msec 2023-09-12 21:00:35,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-12 21:00:35,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a9f11e9ce2bef58e1010f2e0dd60ef55, UNASSIGN in 175 msec 2023-09-12 21:00:35,823 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552435823"}]},"ts":"1694552435823"} 2023-09-12 21:00:35,824 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-12 21:00:35,826 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-12 21:00:35,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 190 msec 2023-09-12 21:00:35,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-12 21:00:35,943 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-12 21:00:35,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-09-12 21:00:35,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-12 21:00:35,947 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-12 21:00:35,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-12 21:00:35,947 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-12 21:00:35,950 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-12 21:00:35,953 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55 2023-09-12 21:00:35,953 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60 2023-09-12 21:00:35,953 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 21:00:35,953 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 21:00:35,953 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 21:00:35,953 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 21:00:35,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-12 21:00:35,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-12 21:00:35,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-12 21:00:35,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-12 21:00:35,955 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 21:00:35,955 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:35,955 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 21:00:35,955 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 21:00:35,955 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:35,955 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:35,955 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 21:00:35,955 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:35,956 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/recovered.edits] 2023-09-12 21:00:35,956 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/recovered.edits] 2023-09-12 21:00:35,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-12 21:00:35,960 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/cf/7c3d17c76601472286d8a8dcc439d6e7 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/cf/7c3d17c76601472286d8a8dcc439d6e7 2023-09-12 21:00:35,961 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/cf/7367c1dd2ce44f6e9eb355acaa7a840c to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/cf/7367c1dd2ce44f6e9eb355acaa7a840c 2023-09-12 21:00:35,963 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/recovered.edits/9.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55/recovered.edits/9.seqid 2023-09-12 21:00:35,964 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/recovered.edits/9.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60/recovered.edits/9.seqid 2023-09-12 21:00:35,964 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/a9f11e9ce2bef58e1010f2e0dd60ef55 2023-09-12 21:00:35,964 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testConsecutiveExports/510195b7e534bbec1b4290f3a2a16f60 2023-09-12 21:00:35,964 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-12 21:00:35,965 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-12 21:00:35,965 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-12 21:00:35,969 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230912f5d3eefccd8444738995e06173bd0adb to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230912f5d3eefccd8444738995e06173bd0adb 2023-09-12 21:00:35,970 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091255363de818564baabb6ba5fef975b71b to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091255363de818564baabb6ba5fef975b71b 2023-09-12 21:00:35,970 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-12 21:00:35,972 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-12 21:00:35,974 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-12 21:00:35,976 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-12 21:00:35,977 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-12 21:00:35,977 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-12 21:00:35,977 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694552435977"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:35,977 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694552435977"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:35,978 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-12 21:00:35,978 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a9f11e9ce2bef58e1010f2e0dd60ef55, NAME => 'testtb-testConsecutiveExports,,1694552406290.a9f11e9ce2bef58e1010f2e0dd60ef55.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 510195b7e534bbec1b4290f3a2a16f60, NAME => 'testtb-testConsecutiveExports,1,1694552406290.510195b7e534bbec1b4290f3a2a16f60.', STARTKEY => '1', ENDKEY => ''}] 2023-09-12 21:00:35,978 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-12 21:00:35,979 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694552435978"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:35,980 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-12 21:00:35,982 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-12 21:00:35,983 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 38 msec 2023-09-12 21:00:36,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-12 21:00:36,057 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-12 21:00:36,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-12 21:00:36,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-12 21:00:36,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-09-12 21:00:36,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-12 21:00:36,091 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=755 (was 768), OpenFileDescriptor=906 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=287 (was 284) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 171), AvailableMemoryMB=5849 (was 5952) 2023-09-12 21:00:36,091 WARN [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-12 21:00:36,109 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=755, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=168, AvailableMemoryMB=5848 2023-09-12 21:00:36,109 WARN [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-12 21:00:36,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-12 21:00:36,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,114 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 21:00:36,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-12 21:00:36,114 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 21:00:36,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-12 21:00:36,117 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae 2023-09-12 21:00:36,117 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85 2023-09-12 21:00:36,117 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae empty. 2023-09-12 21:00:36,118 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85 empty. 2023-09-12 21:00:36,118 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae 2023-09-12 21:00:36,118 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85 2023-09-12 21:00:36,118 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-12 21:00:36,127 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-12 21:00:36,128 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 75c66e51e2ec4f94b5545735dece68ae, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 21:00:36,128 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 598af0e5ec24d1fb47e07fc4fb367b85, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 21:00:36,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:36,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 75c66e51e2ec4f94b5545735dece68ae, disabling compactions & flushes 2023-09-12 21:00:36,141 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:36,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:36,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. after waiting 0 ms 2023-09-12 21:00:36,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:36,141 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:36,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 75c66e51e2ec4f94b5545735dece68ae: 2023-09-12 21:00:36,143 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:36,143 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 598af0e5ec24d1fb47e07fc4fb367b85, disabling compactions & flushes 2023-09-12 21:00:36,143 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:36,143 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:36,143 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. after waiting 0 ms 2023-09-12 21:00:36,143 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:36,143 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:36,143 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 598af0e5ec24d1fb47e07fc4fb367b85: 2023-09-12 21:00:36,145 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 21:00:36,146 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694552436146"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552436146"}]},"ts":"1694552436146"} 2023-09-12 21:00:36,146 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694552436146"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552436146"}]},"ts":"1694552436146"} 2023-09-12 21:00:36,151 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 21:00:36,152 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 21:00:36,152 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552436152"}]},"ts":"1694552436152"} 2023-09-12 21:00:36,153 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-12 21:00:36,157 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-12 21:00:36,158 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 21:00:36,158 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 21:00:36,158 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 21:00:36,158 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 21:00:36,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75c66e51e2ec4f94b5545735dece68ae, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=598af0e5ec24d1fb47e07fc4fb367b85, ASSIGN}] 2023-09-12 21:00:36,160 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=598af0e5ec24d1fb47e07fc4fb367b85, ASSIGN 2023-09-12 21:00:36,160 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75c66e51e2ec4f94b5545735dece68ae, ASSIGN 2023-09-12 21:00:36,161 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=598af0e5ec24d1fb47e07fc4fb367b85, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45939,1694552367290; forceNewPlan=false, retain=false 2023-09-12 21:00:36,161 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75c66e51e2ec4f94b5545735dece68ae, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42813,1694552367323; forceNewPlan=false, retain=false 2023-09-12 21:00:36,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-12 21:00:36,311 INFO [jenkins-hbase9:38453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 21:00:36,314 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=598af0e5ec24d1fb47e07fc4fb367b85, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,314 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=75c66e51e2ec4f94b5545735dece68ae, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,314 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694552436313"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552436313"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552436313"}]},"ts":"1694552436313"} 2023-09-12 21:00:36,314 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694552436313"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552436313"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552436313"}]},"ts":"1694552436313"} 2023-09-12 21:00:36,315 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 598af0e5ec24d1fb47e07fc4fb367b85, server=jenkins-hbase9.apache.org,45939,1694552367290}] 2023-09-12 21:00:36,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 75c66e51e2ec4f94b5545735dece68ae, server=jenkins-hbase9.apache.org,42813,1694552367323}] 2023-09-12 21:00:36,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-12 21:00:36,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:36,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:36,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 598af0e5ec24d1fb47e07fc4fb367b85, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85.', STARTKEY => '1', ENDKEY => ''} 2023-09-12 21:00:36,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 75c66e51e2ec4f94b5545735dece68ae, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae.', STARTKEY => '', ENDKEY => '1'} 2023-09-12 21:00:36,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. service=AccessControlService 2023-09-12 21:00:36,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. service=AccessControlService 2023-09-12 21:00:36,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 21:00:36,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 21:00:36,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 598af0e5ec24d1fb47e07fc4fb367b85 2023-09-12 21:00:36,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 75c66e51e2ec4f94b5545735dece68ae 2023-09-12 21:00:36,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:36,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:36,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 598af0e5ec24d1fb47e07fc4fb367b85 2023-09-12 21:00:36,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 75c66e51e2ec4f94b5545735dece68ae 2023-09-12 21:00:36,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 598af0e5ec24d1fb47e07fc4fb367b85 2023-09-12 21:00:36,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 75c66e51e2ec4f94b5545735dece68ae 2023-09-12 21:00:36,476 INFO [StoreOpener-75c66e51e2ec4f94b5545735dece68ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 75c66e51e2ec4f94b5545735dece68ae 2023-09-12 21:00:36,476 INFO [StoreOpener-598af0e5ec24d1fb47e07fc4fb367b85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 598af0e5ec24d1fb47e07fc4fb367b85 2023-09-12 21:00:36,478 DEBUG [StoreOpener-75c66e51e2ec4f94b5545735dece68ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/cf 2023-09-12 21:00:36,478 DEBUG [StoreOpener-75c66e51e2ec4f94b5545735dece68ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/cf 2023-09-12 21:00:36,478 DEBUG [StoreOpener-598af0e5ec24d1fb47e07fc4fb367b85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/cf 2023-09-12 21:00:36,478 DEBUG [StoreOpener-598af0e5ec24d1fb47e07fc4fb367b85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/cf 2023-09-12 21:00:36,479 INFO [StoreOpener-75c66e51e2ec4f94b5545735dece68ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75c66e51e2ec4f94b5545735dece68ae columnFamilyName cf 2023-09-12 21:00:36,479 INFO [StoreOpener-598af0e5ec24d1fb47e07fc4fb367b85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 598af0e5ec24d1fb47e07fc4fb367b85 columnFamilyName cf 2023-09-12 21:00:36,480 INFO [StoreOpener-75c66e51e2ec4f94b5545735dece68ae-1] regionserver.HStore(310): Store=75c66e51e2ec4f94b5545735dece68ae/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 21:00:36,480 INFO [StoreOpener-598af0e5ec24d1fb47e07fc4fb367b85-1] regionserver.HStore(310): Store=598af0e5ec24d1fb47e07fc4fb367b85/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 21:00:36,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae 2023-09-12 21:00:36,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85 2023-09-12 21:00:36,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae 2023-09-12 21:00:36,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85 2023-09-12 21:00:36,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 75c66e51e2ec4f94b5545735dece68ae 2023-09-12 21:00:36,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 598af0e5ec24d1fb47e07fc4fb367b85 2023-09-12 21:00:36,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 21:00:36,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 75c66e51e2ec4f94b5545735dece68ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60873743, jitterRate=-0.09291054308414459}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 21:00:36,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 21:00:36,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 75c66e51e2ec4f94b5545735dece68ae: 2023-09-12 21:00:36,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 598af0e5ec24d1fb47e07fc4fb367b85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68911888, jitterRate=0.026867151260375977}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 21:00:36,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 598af0e5ec24d1fb47e07fc4fb367b85: 2023-09-12 21:00:36,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae., pid=61, masterSystemTime=1694552436467 2023-09-12 21:00:36,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85., pid=60, masterSystemTime=1694552436467 2023-09-12 21:00:36,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:36,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:36,490 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=75c66e51e2ec4f94b5545735dece68ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,491 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694552436490"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552436490"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552436490"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552436490"}]},"ts":"1694552436490"} 2023-09-12 21:00:36,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:36,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:36,491 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=598af0e5ec24d1fb47e07fc4fb367b85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,491 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694552436491"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552436491"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552436491"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552436491"}]},"ts":"1694552436491"} 2023-09-12 21:00:36,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-12 21:00:36,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 75c66e51e2ec4f94b5545735dece68ae, server=jenkins-hbase9.apache.org,42813,1694552367323 in 176 msec 2023-09-12 21:00:36,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-12 21:00:36,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 598af0e5ec24d1fb47e07fc4fb367b85, server=jenkins-hbase9.apache.org,45939,1694552367290 in 178 msec 2023-09-12 21:00:36,495 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75c66e51e2ec4f94b5545735dece68ae, ASSIGN in 336 msec 2023-09-12 21:00:36,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-12 21:00:36,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=598af0e5ec24d1fb47e07fc4fb367b85, ASSIGN in 337 msec 2023-09-12 21:00:36,497 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 21:00:36,497 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552436497"}]},"ts":"1694552436497"} 2023-09-12 21:00:36,498 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-12 21:00:36,500 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 21:00:36,501 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-12 21:00:36,502 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-12 21:00:36,504 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:36,504 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:36,504 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:36,504 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:36,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:36,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:36,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:36,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:36,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 395 msec 2023-09-12 21:00:36,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-12 21:00:36,718 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-12 21:00:36,720 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,720 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:36,722 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 21:00:36,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-12 21:00:36,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694552436733 (current time:1694552436733). 2023-09-12 21:00:36,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 21:00:36,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x1ea5453c to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:36,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d9ab69a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:36,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:36,743 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:36,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ea5453c to 127.0.0.1:58083 2023-09-12 21:00:36,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:36,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x1c0626c5 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:36,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@283e1cdc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:36,750 DEBUG [hconnection-0x60d85127-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:36,751 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:36,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:36,756 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:36,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c0626c5 to 127.0.0.1:58083 2023-09-12 21:00:36,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:36,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-12 21:00:36,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 21:00:36,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-12 21:00:36,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-12 21:00:36,763 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-12 21:00:36,764 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694553036764 2023-09-12 21:00:36,764 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-12 21:00:36,765 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 21:00:36,765 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 21:00:36,766 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-12 21:00:36,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-12 21:00:36,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-12 21:00:36,768 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-12 21:00:36,768 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694553036768 2023-09-12 21:00:36,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,778 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-12 21:00:36,778 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:36,779 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-12 21:00:36,779 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-12 21:00:36,779 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,779 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,780 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:36,780 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:36,780 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:36,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:36,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:36,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:36,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:36,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:36,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:36,780 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,781 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,781 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,782 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-12 21:00:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-12 21:00:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-12 21:00:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,782 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 21:00:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-12 21:00:36,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-12 21:00:36,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-12 21:00:36,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,782 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-12 21:00:36,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,782 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-12 21:00:36,782 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:36,783 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:36,783 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-12 21:00:36,784 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-12 21:00:36,784 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-12 21:00:36,782 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-12 21:00:36,784 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-12 21:00:36,784 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-12 21:00:36,784 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-12 21:00:36,784 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:36,785 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-12 21:00:36,785 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-12 21:00:36,785 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-12 21:00:36,786 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,786 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:36,787 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,787 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,787 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,787 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:36,787 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,787 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,788 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:36,788 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,788 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:36,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-12 21:00:36,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42fb59f0[Count = 1] remaining members to acquire global barrier 2023-09-12 21:00:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:36,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-12 21:00:36,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42fb59f0[Count = 0] remaining members to acquire global barrier 2023-09-12 21:00:36,792 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-12 21:00:36,792 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,794 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,794 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,794 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,794 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,794 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-12 21:00:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,795 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-12 21:00:36,795 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-12 21:00:36,794 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-12 21:00:36,795 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,795 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 21:00:36,795 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:00:36,795 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:00:36,795 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,34031,1694552367245' in zk 2023-09-12 21:00:36,795 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:36,795 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:00:36,795 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:00:36,795 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:36,795 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. started... 2023-09-12 21:00:36,795 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. started... 2023-09-12 21:00:36,796 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 75c66e51e2ec4f94b5545735dece68ae: 2023-09-12 21:00:36,796 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 598af0e5ec24d1fb47e07fc4fb367b85: 2023-09-12 21:00:36,796 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,796 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,796 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:00:36,796 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:00:36,796 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 21:00:36,796 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 21:00:36,804 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-12 21:00:36,804 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:36,804 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-12 21:00:36,813 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. completed. 2023-09-12 21:00:36,813 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:36,813 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:00:36,813 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:00:36,813 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,813 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. completed. 2023-09-12 21:00:36,813 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-12 21:00:36,813 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,42813,1694552367323' in zk 2023-09-12 21:00:36,813 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:36,813 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:00:36,814 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:00:36,814 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,814 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-12 21:00:36,814 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,45939,1694552367290' in zk 2023-09-12 21:00:36,815 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-12 21:00:36,815 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,815 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:36,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:36,815 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-12 21:00:36,816 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-12 21:00:36,816 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,816 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:36,816 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-12 21:00:36,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,42813,1694552367323': 2023-09-12 21:00:36,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-12 21:00:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:36,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,45939,1694552367290': 2023-09-12 21:00:36,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-12 21:00:36,824 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-12 21:00:36,824 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 21:00:36,824 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 21:00:36,824 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,824 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 21:00:36,826 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,826 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,826 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:36,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,826 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,826 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,827 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:36,826 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:36,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:36,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:36,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:36,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:36,828 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:36,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,828 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,829 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:36,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:36,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:36,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:36,830 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,831 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,831 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:36,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:36,834 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:36,834 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,834 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:36,834 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,834 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:36,834 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,834 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:36,834 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:36,834 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:36,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:36,834 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:36,834 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,834 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:36,834 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,834 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:36,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:36,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:36,834 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,836 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:36,836 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:36,836 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,836 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:36,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:36,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:36,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:36,834 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:36,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:36,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:36,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 21:00:36,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:36,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-12 21:00:36,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,865 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:00:36,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-12 21:00:36,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-12 21:00:36,867 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 21:00:36,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,875 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-12 21:00:36,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,876 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:36,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694552436764Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694552436848 (+84 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694552436848Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694552436848Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694552436853 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694552436865 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694552436875 (+10 ms) 2023-09-12 21:00:36,877 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-12 21:00:36,879 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 112 msec 2023-09-12 21:00:37,067 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:00:37,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-12 21:00:37,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 21:00:37,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42813] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 21:00:37,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45939] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 21:00:37,074 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,074 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:37,074 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 21:00:37,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-12 21:00:37,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694552437083 (current time:1694552437083). 2023-09-12 21:00:37,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 21:00:37,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x5196df90 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:37,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1018ac6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:37,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:37,093 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:37,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5196df90 to 127.0.0.1:58083 2023-09-12 21:00:37,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:37,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x494be757 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:37,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ec6dbb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:37,102 DEBUG [hconnection-0x7be869db-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:37,104 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:37,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:37,109 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:37,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x494be757 to 127.0.0.1:58083 2023-09-12 21:00:37,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:37,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-12 21:00:37,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 21:00:37,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-12 21:00:37,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-12 21:00:37,114 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-12 21:00:37,114 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694553037114 2023-09-12 21:00:37,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-12 21:00:37,114 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,115 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 21:00:37,116 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 21:00:37,116 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-12 21:00:37,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-12 21:00:37,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-12 21:00:37,118 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-12 21:00:37,119 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694553037119 2023-09-12 21:00:37,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,126 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-12 21:00:37,126 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:37,127 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-12 21:00:37,127 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-12 21:00:37,127 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,127 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,128 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:37,128 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:37,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:37,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:37,128 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,128 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:37,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:37,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:37,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:37,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:37,129 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,129 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,129 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,130 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 21:00:37,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-12 21:00:37,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-12 21:00:37,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-12 21:00:37,130 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-12 21:00:37,130 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-12 21:00:37,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,130 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-12 21:00:37,130 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-12 21:00:37,130 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-12 21:00:37,130 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:37,130 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:37,131 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-12 21:00:37,131 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,131 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-12 21:00:37,131 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-12 21:00:37,131 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-12 21:00:37,131 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-12 21:00:37,131 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-12 21:00:37,131 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:37,131 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-12 21:00:37,132 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-12 21:00:37,132 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-12 21:00:37,132 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-12 21:00:37,133 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,133 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:37,135 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,136 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:37,136 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,135 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,136 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:37,136 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,136 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:37,136 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,136 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:37,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-12 21:00:37,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e08e82d[Count = 1] remaining members to acquire global barrier 2023-09-12 21:00:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:37,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:37,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:37,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:37,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-12 21:00:37,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e08e82d[Count = 0] remaining members to acquire global barrier 2023-09-12 21:00:37,139 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-12 21:00:37,139 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,140 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,141 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,141 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,141 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-12 21:00:37,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,141 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-12 21:00:37,141 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,141 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,34031,1694552367245' in zk 2023-09-12 21:00:37,141 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-12 21:00:37,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,141 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-12 21:00:37,141 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,141 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 21:00:37,141 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:37,141 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:00:37,141 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:00:37,141 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:00:37,141 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:00:37,141 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:37,141 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. started... 2023-09-12 21:00:37,142 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. started... 2023-09-12 21:00:37,142 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 75c66e51e2ec4f94b5545735dece68ae 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-12 21:00:37,142 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 598af0e5ec24d1fb47e07fc4fb367b85 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-12 21:00:37,142 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-12 21:00:37,143 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:37,143 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-12 21:00:37,161 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309128d2016a26564448ea15608f46b7123f7 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309128d2016a26564448ea15608f46b7123f7 2023-09-12 21:00:37,161 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230912be2ca7a02ffb4dbd95fc0e793a3c33d0 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230912be2ca7a02ffb4dbd95fc0e793a3c33d0 2023-09-12 21:00:37,169 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/.tmp/cf/5bca22b341c346069698acb81ca728e5 2023-09-12 21:00:37,170 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/.tmp/cf/bd3236c58ab6456c96c52713b0200d23 2023-09-12 21:00:37,174 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/.tmp/cf/bd3236c58ab6456c96c52713b0200d23 as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/cf/bd3236c58ab6456c96c52713b0200d23 2023-09-12 21:00:37,174 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/.tmp/cf/5bca22b341c346069698acb81ca728e5 as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/cf/5bca22b341c346069698acb81ca728e5 2023-09-12 21:00:37,179 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/cf/bd3236c58ab6456c96c52713b0200d23, entries=47, sequenceid=6, filesize=13.5 K 2023-09-12 21:00:37,179 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 598af0e5ec24d1fb47e07fc4fb367b85 in 37ms, sequenceid=6, compaction requested=false 2023-09-12 21:00:37,180 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/cf/5bca22b341c346069698acb81ca728e5, entries=3, sequenceid=6, filesize=5.4 K 2023-09-12 21:00:37,180 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-12 21:00:37,180 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 75c66e51e2ec4f94b5545735dece68ae in 38ms, sequenceid=6, compaction requested=false 2023-09-12 21:00:37,180 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 598af0e5ec24d1fb47e07fc4fb367b85: 2023-09-12 21:00:37,181 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 75c66e51e2ec4f94b5545735dece68ae: 2023-09-12 21:00:37,181 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,181 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,182 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:00:37,182 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:00:37,182 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/cf/bd3236c58ab6456c96c52713b0200d23] hfiles 2023-09-12 21:00:37,182 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/cf/5bca22b341c346069698acb81ca728e5] hfiles 2023-09-12 21:00:37,182 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/cf/bd3236c58ab6456c96c52713b0200d23 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,182 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/cf/5bca22b341c346069698acb81ca728e5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,191 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. completed. 2023-09-12 21:00:37,191 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:00:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:00:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-12 21:00:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,42813,1694552367323' in zk 2023-09-12 21:00:37,191 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. completed. 2023-09-12 21:00:37,192 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:37,192 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:00:37,192 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:00:37,192 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,192 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-12 21:00:37,192 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,45939,1694552367290' in zk 2023-09-12 21:00:37,193 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,193 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-12 21:00:37,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:37,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:37,193 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:37,193 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-12 21:00:37,195 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:37,195 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-12 21:00:37,195 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:37,195 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-12 21:00:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,42813,1694552367323': 2023-09-12 21:00:37,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-12 21:00:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,45939,1694552367290': 2023-09-12 21:00:37,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-12 21:00:37,203 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-12 21:00:37,203 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 21:00:37,203 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 21:00:37,203 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,203 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 21:00:37,207 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,207 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,207 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:37,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,207 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,207 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,207 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:37,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:37,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:37,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:37,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,207 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:37,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,207 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:37,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:37,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:37,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:37,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:37,208 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:37,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,209 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,210 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:37,210 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,211 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,213 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,213 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:37,213 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:37,213 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:37,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:37,213 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,214 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:37,213 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:37,213 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:37,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:37,213 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:37,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:37,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:37,215 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:37,214 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,214 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:37,215 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:37,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:37,215 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,215 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,215 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,215 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 21:00:37,216 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:37,216 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,216 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,216 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:00:37,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230912be2ca7a02ffb4dbd95fc0e793a3c33d0, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309128d2016a26564448ea15608f46b7123f7] mob files 2023-09-12 21:00:37,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230912be2ca7a02ffb4dbd95fc0e793a3c33d0 2023-09-12 21:00:37,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309128d2016a26564448ea15608f46b7123f7 2023-09-12 21:00:37,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-12 21:00:37,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-12 21:00:37,217 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 21:00:37,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,239 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-12 21:00:37,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,239 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:37,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694552437115Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694552437222 (+107 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694552437222Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1694552437222Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1694552437225 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694552437232 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694552437239 (+7 ms) 2023-09-12 21:00:37,242 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-12 21:00:37,243 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 127 msec 2023-09-12 21:00:37,417 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:00:37,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-12 21:00:37,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 21:00:37,445 DEBUG [Listener at jenkins-hbase9.apache.org/32837] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-12 21:00:37,448 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-12 21:00:37,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34031] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-12 21:00:37,449 DEBUG [Listener at jenkins-hbase9.apache.org/32837] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-12 21:00:37,452 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-12 21:00:37,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42813] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-12 21:00:37,452 DEBUG [Listener at jenkins-hbase9.apache.org/32837] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-12 21:00:37,456 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39168, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-12 21:00:37,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45939] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-12 21:00:37,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-12 21:00:37,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:37,461 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 21:00:37,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-12 21:00:37,461 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 21:00:37,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-12 21:00:37,464 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:37,464 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:37,464 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31 empty. 2023-09-12 21:00:37,464 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5 empty. 2023-09-12 21:00:37,465 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:37,465 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:37,465 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-12 21:00:37,475 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-12 21:00:37,476 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => bce76dc0bf0ad762ec93da7cd548ed31, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 21:00:37,477 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 31b563b1024e7dabe77a5c0205429ae5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 21:00:37,484 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:37,485 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 31b563b1024e7dabe77a5c0205429ae5, disabling compactions & flushes 2023-09-12 21:00:37,485 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. 2023-09-12 21:00:37,485 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. 2023-09-12 21:00:37,485 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. after waiting 0 ms 2023-09-12 21:00:37,485 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. 2023-09-12 21:00:37,485 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. 2023-09-12 21:00:37,485 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 31b563b1024e7dabe77a5c0205429ae5: 2023-09-12 21:00:37,486 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:37,486 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing bce76dc0bf0ad762ec93da7cd548ed31, disabling compactions & flushes 2023-09-12 21:00:37,486 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. 2023-09-12 21:00:37,486 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. 2023-09-12 21:00:37,486 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. after waiting 0 ms 2023-09-12 21:00:37,486 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. 2023-09-12 21:00:37,486 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. 2023-09-12 21:00:37,486 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for bce76dc0bf0ad762ec93da7cd548ed31: 2023-09-12 21:00:37,488 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 21:00:37,489 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694552437489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552437489"}]},"ts":"1694552437489"} 2023-09-12 21:00:37,489 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694552437489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552437489"}]},"ts":"1694552437489"} 2023-09-12 21:00:37,491 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 21:00:37,491 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 21:00:37,491 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552437491"}]},"ts":"1694552437491"} 2023-09-12 21:00:37,493 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-12 21:00:37,497 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-12 21:00:37,498 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 21:00:37,498 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 21:00:37,498 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 21:00:37,498 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 21:00:37,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bce76dc0bf0ad762ec93da7cd548ed31, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31b563b1024e7dabe77a5c0205429ae5, ASSIGN}] 2023-09-12 21:00:37,501 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31b563b1024e7dabe77a5c0205429ae5, ASSIGN 2023-09-12 21:00:37,501 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bce76dc0bf0ad762ec93da7cd548ed31, ASSIGN 2023-09-12 21:00:37,501 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31b563b1024e7dabe77a5c0205429ae5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45939,1694552367290; forceNewPlan=false, retain=false 2023-09-12 21:00:37,501 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bce76dc0bf0ad762ec93da7cd548ed31, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34031,1694552367245; forceNewPlan=false, retain=false 2023-09-12 21:00:37,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-12 21:00:37,652 INFO [jenkins-hbase9:38453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 21:00:37,654 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=31b563b1024e7dabe77a5c0205429ae5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,654 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bce76dc0bf0ad762ec93da7cd548ed31, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,654 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694552437654"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552437654"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552437654"}]},"ts":"1694552437654"} 2023-09-12 21:00:37,654 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694552437654"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552437654"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552437654"}]},"ts":"1694552437654"} 2023-09-12 21:00:37,656 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 31b563b1024e7dabe77a5c0205429ae5, server=jenkins-hbase9.apache.org,45939,1694552367290}] 2023-09-12 21:00:37,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure bce76dc0bf0ad762ec93da7cd548ed31, server=jenkins-hbase9.apache.org,34031,1694552367245}] 2023-09-12 21:00:37,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-12 21:00:37,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. 2023-09-12 21:00:37,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. 2023-09-12 21:00:37,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bce76dc0bf0ad762ec93da7cd548ed31, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31.', STARTKEY => '', ENDKEY => '2'} 2023-09-12 21:00:37,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 31b563b1024e7dabe77a5c0205429ae5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5.', STARTKEY => '2', ENDKEY => ''} 2023-09-12 21:00:37,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. service=AccessControlService 2023-09-12 21:00:37,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 21:00:37,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:37,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:37,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:37,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:37,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. service=AccessControlService 2023-09-12 21:00:37,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 21:00:37,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:37,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:37,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:37,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:37,813 INFO [StoreOpener-bce76dc0bf0ad762ec93da7cd548ed31-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:37,813 INFO [StoreOpener-31b563b1024e7dabe77a5c0205429ae5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:37,814 DEBUG [StoreOpener-bce76dc0bf0ad762ec93da7cd548ed31-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/cf 2023-09-12 21:00:37,814 DEBUG [StoreOpener-bce76dc0bf0ad762ec93da7cd548ed31-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/cf 2023-09-12 21:00:37,814 INFO [StoreOpener-bce76dc0bf0ad762ec93da7cd548ed31-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bce76dc0bf0ad762ec93da7cd548ed31 columnFamilyName cf 2023-09-12 21:00:37,815 DEBUG [StoreOpener-31b563b1024e7dabe77a5c0205429ae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/cf 2023-09-12 21:00:37,815 DEBUG [StoreOpener-31b563b1024e7dabe77a5c0205429ae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/cf 2023-09-12 21:00:37,815 INFO [StoreOpener-bce76dc0bf0ad762ec93da7cd548ed31-1] regionserver.HStore(310): Store=bce76dc0bf0ad762ec93da7cd548ed31/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 21:00:37,815 INFO [StoreOpener-31b563b1024e7dabe77a5c0205429ae5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31b563b1024e7dabe77a5c0205429ae5 columnFamilyName cf 2023-09-12 21:00:37,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:37,816 INFO [StoreOpener-31b563b1024e7dabe77a5c0205429ae5-1] regionserver.HStore(310): Store=31b563b1024e7dabe77a5c0205429ae5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 21:00:37,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:37,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:37,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:37,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:37,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:37,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 21:00:37,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened bce76dc0bf0ad762ec93da7cd548ed31; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68157063, jitterRate=0.01561938226222992}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 21:00:37,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for bce76dc0bf0ad762ec93da7cd548ed31: 2023-09-12 21:00:37,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 21:00:37,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31., pid=70, masterSystemTime=1694552437807 2023-09-12 21:00:37,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 31b563b1024e7dabe77a5c0205429ae5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70562595, jitterRate=0.05146460235118866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 21:00:37,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 31b563b1024e7dabe77a5c0205429ae5: 2023-09-12 21:00:37,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5., pid=69, masterSystemTime=1694552437807 2023-09-12 21:00:37,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. 2023-09-12 21:00:37,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. 2023-09-12 21:00:37,825 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bce76dc0bf0ad762ec93da7cd548ed31, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:37,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. 2023-09-12 21:00:37,825 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694552437824"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552437824"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552437824"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552437824"}]},"ts":"1694552437824"} 2023-09-12 21:00:37,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. 2023-09-12 21:00:37,825 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=31b563b1024e7dabe77a5c0205429ae5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:37,825 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694552437825"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552437825"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552437825"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552437825"}]},"ts":"1694552437825"} 2023-09-12 21:00:37,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-12 21:00:37,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure bce76dc0bf0ad762ec93da7cd548ed31, server=jenkins-hbase9.apache.org,34031,1694552367245 in 170 msec 2023-09-12 21:00:37,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-12 21:00:37,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 31b563b1024e7dabe77a5c0205429ae5, server=jenkins-hbase9.apache.org,45939,1694552367290 in 172 msec 2023-09-12 21:00:37,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bce76dc0bf0ad762ec93da7cd548ed31, ASSIGN in 330 msec 2023-09-12 21:00:37,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-12 21:00:37,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31b563b1024e7dabe77a5c0205429ae5, ASSIGN in 330 msec 2023-09-12 21:00:37,831 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 21:00:37,831 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552437831"}]},"ts":"1694552437831"} 2023-09-12 21:00:37,832 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-12 21:00:37,834 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 21:00:37,834 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-12 21:00:37,836 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-12 21:00:37,837 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:37,837 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:37,837 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:37,837 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:37,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:37,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:37,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:37,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:37,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:37,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:37,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:37,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:37,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 380 msec 2023-09-12 21:00:38,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-12 21:00:38,065 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-12 21:00:38,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions bce76dc0bf0ad762ec93da7cd548ed31, 31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:38,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bce76dc0bf0ad762ec93da7cd548ed31, 31b563b1024e7dabe77a5c0205429ae5], force=true 2023-09-12 21:00:38,094 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bce76dc0bf0ad762ec93da7cd548ed31, 31b563b1024e7dabe77a5c0205429ae5], force=true 2023-09-12 21:00:38,095 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bce76dc0bf0ad762ec93da7cd548ed31, 31b563b1024e7dabe77a5c0205429ae5], force=true 2023-09-12 21:00:38,095 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bce76dc0bf0ad762ec93da7cd548ed31, 31b563b1024e7dabe77a5c0205429ae5], force=true 2023-09-12 21:00:38,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-12 21:00:38,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bce76dc0bf0ad762ec93da7cd548ed31, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31b563b1024e7dabe77a5c0205429ae5, UNASSIGN}] 2023-09-12 21:00:38,116 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31b563b1024e7dabe77a5c0205429ae5, UNASSIGN 2023-09-12 21:00:38,116 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bce76dc0bf0ad762ec93da7cd548ed31, UNASSIGN 2023-09-12 21:00:38,117 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=31b563b1024e7dabe77a5c0205429ae5, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:38,117 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bce76dc0bf0ad762ec93da7cd548ed31, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:38,117 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694552438117"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552438117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552438117"}]},"ts":"1694552438117"} 2023-09-12 21:00:38,117 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694552438117"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552438117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552438117"}]},"ts":"1694552438117"} 2023-09-12 21:00:38,118 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 31b563b1024e7dabe77a5c0205429ae5, server=jenkins-hbase9.apache.org,45939,1694552367290}] 2023-09-12 21:00:38,119 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure bce76dc0bf0ad762ec93da7cd548ed31, server=jenkins-hbase9.apache.org,34031,1694552367245}] 2023-09-12 21:00:38,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-12 21:00:38,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:38,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 31b563b1024e7dabe77a5c0205429ae5, disabling compactions & flushes 2023-09-12 21:00:38,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. 2023-09-12 21:00:38,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. 2023-09-12 21:00:38,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. after waiting 0 ms 2023-09-12 21:00:38,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. 2023-09-12 21:00:38,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 31b563b1024e7dabe77a5c0205429ae5 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-12 21:00:38,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:38,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing bce76dc0bf0ad762ec93da7cd548ed31, disabling compactions & flushes 2023-09-12 21:00:38,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. 2023-09-12 21:00:38,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. 2023-09-12 21:00:38,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. after waiting 0 ms 2023-09-12 21:00:38,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. 2023-09-12 21:00:38,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing bce76dc0bf0ad762ec93da7cd548ed31 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-12 21:00:38,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/.tmp/cf/ed1a4e64d0fa440e83ab93d59b45a991 2023-09-12 21:00:38,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/.tmp/cf/9473646956c74d7996dd2229330f4edd 2023-09-12 21:00:38,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/.tmp/cf/9473646956c74d7996dd2229330f4edd as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/cf/9473646956c74d7996dd2229330f4edd 2023-09-12 21:00:38,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/.tmp/cf/ed1a4e64d0fa440e83ab93d59b45a991 as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/cf/ed1a4e64d0fa440e83ab93d59b45a991 2023-09-12 21:00:38,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/cf/9473646956c74d7996dd2229330f4edd, entries=1, sequenceid=5, filesize=4.7 K 2023-09-12 21:00:38,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/cf/ed1a4e64d0fa440e83ab93d59b45a991, entries=1, sequenceid=5, filesize=4.7 K 2023-09-12 21:00:38,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 31b563b1024e7dabe77a5c0205429ae5 in 32ms, sequenceid=5, compaction requested=false 2023-09-12 21:00:38,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for bce76dc0bf0ad762ec93da7cd548ed31 in 30ms, sequenceid=5, compaction requested=false 2023-09-12 21:00:38,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-12 21:00:38,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-12 21:00:38,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-12 21:00:38,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-12 21:00:38,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:00:38,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:00:38,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31. 2023-09-12 21:00:38,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5. 2023-09-12 21:00:38,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for bce76dc0bf0ad762ec93da7cd548ed31: 2023-09-12 21:00:38,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 31b563b1024e7dabe77a5c0205429ae5: 2023-09-12 21:00:38,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:38,315 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=31b563b1024e7dabe77a5c0205429ae5, regionState=CLOSED 2023-09-12 21:00:38,315 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694552438315"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552438315"}]},"ts":"1694552438315"} 2023-09-12 21:00:38,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:38,316 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bce76dc0bf0ad762ec93da7cd548ed31, regionState=CLOSED 2023-09-12 21:00:38,316 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694552438316"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552438316"}]},"ts":"1694552438316"} 2023-09-12 21:00:38,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-09-12 21:00:38,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 31b563b1024e7dabe77a5c0205429ae5, server=jenkins-hbase9.apache.org,45939,1694552367290 in 199 msec 2023-09-12 21:00:38,320 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-09-12 21:00:38,320 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure bce76dc0bf0ad762ec93da7cd548ed31, server=jenkins-hbase9.apache.org,34031,1694552367245 in 199 msec 2023-09-12 21:00:38,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31b563b1024e7dabe77a5c0205429ae5, UNASSIGN in 205 msec 2023-09-12 21:00:38,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-12 21:00:38,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bce76dc0bf0ad762ec93da7cd548ed31, UNASSIGN in 208 msec 2023-09-12 21:00:38,361 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-12 21:00:38,363 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437458.bce76dc0bf0ad762ec93da7cd548ed31.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:38,363 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694552437458.31b563b1024e7dabe77a5c0205429ae5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:38,364 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:38,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-12 21:00:38,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e4bec80bafd025dcf5efb74ab5dc148, ASSIGN}] 2023-09-12 21:00:38,416 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e4bec80bafd025dcf5efb74ab5dc148, ASSIGN 2023-09-12 21:00:38,417 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e4bec80bafd025dcf5efb74ab5dc148, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,34031,1694552367245; forceNewPlan=false, retain=false 2023-09-12 21:00:38,567 INFO [jenkins-hbase9:38453] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-12 21:00:38,569 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1e4bec80bafd025dcf5efb74ab5dc148, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:38,569 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694552438569"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552438569"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552438569"}]},"ts":"1694552438569"} 2023-09-12 21:00:38,570 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 1e4bec80bafd025dcf5efb74ab5dc148, server=jenkins-hbase9.apache.org,34031,1694552367245}] 2023-09-12 21:00:38,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-12 21:00:38,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148. 2023-09-12 21:00:38,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e4bec80bafd025dcf5efb74ab5dc148, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148.', STARTKEY => '', ENDKEY => ''} 2023-09-12 21:00:38,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148. service=AccessControlService 2023-09-12 21:00:38,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 21:00:38,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 1e4bec80bafd025dcf5efb74ab5dc148 2023-09-12 21:00:38,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:38,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1e4bec80bafd025dcf5efb74ab5dc148 2023-09-12 21:00:38,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1e4bec80bafd025dcf5efb74ab5dc148 2023-09-12 21:00:38,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/.regioninfo 2023-09-12 21:00:38,734 INFO [StoreOpener-1e4bec80bafd025dcf5efb74ab5dc148-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1e4bec80bafd025dcf5efb74ab5dc148 2023-09-12 21:00:38,735 DEBUG [StoreOpener-1e4bec80bafd025dcf5efb74ab5dc148-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/cf 2023-09-12 21:00:38,735 DEBUG [StoreOpener-1e4bec80bafd025dcf5efb74ab5dc148-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/cf 2023-09-12 21:00:38,736 INFO [StoreOpener-1e4bec80bafd025dcf5efb74ab5dc148-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e4bec80bafd025dcf5efb74ab5dc148 columnFamilyName cf 2023-09-12 21:00:38,761 DEBUG [StoreOpener-1e4bec80bafd025dcf5efb74ab5dc148-1] regionserver.HStore(539): loaded hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/cf/9473646956c74d7996dd2229330f4edd.31b563b1024e7dabe77a5c0205429ae5->hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/cf/9473646956c74d7996dd2229330f4edd-top 2023-09-12 21:00:38,767 DEBUG [StoreOpener-1e4bec80bafd025dcf5efb74ab5dc148-1] regionserver.HStore(539): loaded hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/cf/ed1a4e64d0fa440e83ab93d59b45a991.bce76dc0bf0ad762ec93da7cd548ed31->hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/cf/ed1a4e64d0fa440e83ab93d59b45a991-top 2023-09-12 21:00:38,767 INFO [StoreOpener-1e4bec80bafd025dcf5efb74ab5dc148-1] regionserver.HStore(310): Store=1e4bec80bafd025dcf5efb74ab5dc148/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 21:00:38,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148 2023-09-12 21:00:38,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148 2023-09-12 21:00:38,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1e4bec80bafd025dcf5efb74ab5dc148 2023-09-12 21:00:38,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1e4bec80bafd025dcf5efb74ab5dc148; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67322421, jitterRate=0.003182247281074524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 21:00:38,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1e4bec80bafd025dcf5efb74ab5dc148: 2023-09-12 21:00:38,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148., pid=77, masterSystemTime=1694552438722 2023-09-12 21:00:38,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148.,because compaction is disabled. 2023-09-12 21:00:38,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148. 2023-09-12 21:00:38,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148. 2023-09-12 21:00:38,775 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1e4bec80bafd025dcf5efb74ab5dc148, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:38,776 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694552438775"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552438775"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552438775"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552438775"}]},"ts":"1694552438775"} 2023-09-12 21:00:38,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-12 21:00:38,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 1e4bec80bafd025dcf5efb74ab5dc148, server=jenkins-hbase9.apache.org,34031,1694552367245 in 207 msec 2023-09-12 21:00:38,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-12 21:00:38,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e4bec80bafd025dcf5efb74ab5dc148, ASSIGN in 364 msec 2023-09-12 21:00:38,781 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bce76dc0bf0ad762ec93da7cd548ed31, 31b563b1024e7dabe77a5c0205429ae5], force=true in 692 msec 2023-09-12 21:00:39,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-12 21:00:39,201 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-12 21:00:39,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-12 21:00:39,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694552439201 (current time:1694552439201). 2023-09-12 21:00:39,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 21:00:39,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x61b3ca51 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:39,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1eeaafc7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:39,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:39,212 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:39,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61b3ca51 to 127.0.0.1:58083 2023-09-12 21:00:39,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:39,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x3c79b041 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:39,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43e704dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:39,220 DEBUG [hconnection-0x8b81ff1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:39,222 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:39,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:39,227 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:39,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c79b041 to 127.0.0.1:58083 2023-09-12 21:00:39,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:39,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-12 21:00:39,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 21:00:39,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-12 21:00:39,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-12 21:00:39,232 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-12 21:00:39,232 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1694553039232 2023-09-12 21:00:39,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-12 21:00:39,232 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,235 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 21:00:39,236 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 21:00:39,237 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-12 21:00:39,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-12 21:00:39,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-12 21:00:39,238 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-12 21:00:39,239 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1694553039239 2023-09-12 21:00:39,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,247 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-12 21:00:39,247 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:39,247 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-12 21:00:39,247 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-12 21:00:39,248 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,248 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,249 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:39,249 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:39,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:39,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:39,249 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,249 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:39,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:39,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:39,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:39,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:39,250 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,250 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 21:00:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-12 21:00:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-12 21:00:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-12 21:00:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,251 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-12 21:00:39,251 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-12 21:00:39,251 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-12 21:00:39,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,251 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-12 21:00:39,251 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:39,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,252 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-12 21:00:39,252 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-12 21:00:39,252 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-12 21:00:39,252 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:39,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,253 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-12 21:00:39,253 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-12 21:00:39,253 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:39,252 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-12 21:00:39,254 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-12 21:00:39,254 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-12 21:00:39,253 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-12 21:00:39,254 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-12 21:00:39,254 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-12 21:00:39,255 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,256 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,256 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,256 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,256 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:39,256 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:39,256 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,256 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:39,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-12 21:00:39,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c516f95[Count = 0] remaining members to acquire global barrier 2023-09-12 21:00:39,258 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-12 21:00:39,258 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,260 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,260 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,260 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,260 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-12 21:00:39,260 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,260 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:39,260 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,260 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-12 21:00:39,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,260 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 21:00:39,260 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-12 21:00:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,260 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,42813,1694552367323' in zk 2023-09-12 21:00:39,260 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-12 21:00:39,260 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-12 21:00:39,261 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,45939,1694552367290' in zk 2023-09-12 21:00:39,262 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-12 21:00:39,262 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:39,262 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-12 21:00:39,262 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-12 21:00:39,263 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:39,263 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-12 21:00:39,267 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:00:39,267 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:00:39,267 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148. 2023-09-12 21:00:39,267 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148. started... 2023-09-12 21:00:39,268 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e4bec80bafd025dcf5efb74ab5dc148: 2023-09-12 21:00:39,268 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,268 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:00:39,268 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/cf/9473646956c74d7996dd2229330f4edd.31b563b1024e7dabe77a5c0205429ae5->hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/cf/9473646956c74d7996dd2229330f4edd-top, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/cf/ed1a4e64d0fa440e83ab93d59b45a991.bce76dc0bf0ad762ec93da7cd548ed31->hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/cf/ed1a4e64d0fa440e83ab93d59b45a991-top] hfiles 2023-09-12 21:00:39,268 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/cf/9473646956c74d7996dd2229330f4edd.31b563b1024e7dabe77a5c0205429ae5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,269 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/cf/ed1a4e64d0fa440e83ab93d59b45a991.bce76dc0bf0ad762ec93da7cd548ed31 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,275 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148. completed. 2023-09-12 21:00:39,275 DEBUG [rs(jenkins-hbase9.apache.org,34031,1694552367245)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148. 2023-09-12 21:00:39,275 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:00:39,275 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:00:39,275 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,275 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-12 21:00:39,276 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,34031,1694552367245' in zk 2023-09-12 21:00:39,282 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-12 21:00:39,282 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,282 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:39,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,282 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-12 21:00:39,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:39,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:39,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:39,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:39,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:39,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:39,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,34031,1694552367245': 2023-09-12 21:00:39,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-12 21:00:39,285 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-12 21:00:39,285 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 21:00:39,285 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 21:00:39,285 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,285 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 21:00:39,286 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,287 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,287 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,287 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:39,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,287 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:39,286 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:39,287 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:39,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:39,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:39,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,287 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,287 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:39,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:39,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:39,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:39,288 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:39,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:39,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:39,290 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:39,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,290 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:39,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:39,290 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:39,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,293 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,293 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,293 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:39,293 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:39,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:39,293 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:39,293 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:39,293 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,293 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:39,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:39,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:39,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:39,293 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:39,293 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:39,293 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:39,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:39,294 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:39,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:39,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:39,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,294 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:39,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:39,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:39,294 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:39,294 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,294 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:39,294 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:39,294 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,294 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:39,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:39,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,313 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-12 21:00:39,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,313 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1694552439233Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694552439293 (+60 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694552439293Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694552439296 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694552439306 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1694552439313 (+7 ms) 2023-09-12 21:00:39,316 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-12 21:00:39,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 82 msec 2023-09-12 21:00:39,336 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:00:39,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-12 21:00:39,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 21:00:39,337 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552439337 2023-09-12 21:00:39,337 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38861, tgtDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552439337, rawTgtDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552439337, srcFsUri=hdfs://localhost:38861, srcDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 21:00:39,358 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 21:00:39,358 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-201471427_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552439337, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552439337/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,358 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944, snapshotDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-12 21:00:39,366 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552439337/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:39,386 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:39,387 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:39,387 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:39,387 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:40,229 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-4977757868611547001.jar 2023-09-12 21:00:40,230 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:40,230 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:40,294 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-6109267855833547425.jar 2023-09-12 21:00:40,295 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:40,295 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:40,295 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:40,296 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:40,296 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:40,296 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:40,297 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 21:00:40,297 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 21:00:40,297 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 21:00:40,298 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 21:00:40,298 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 21:00:40,298 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 21:00:40,299 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 21:00:40,299 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 21:00:40,299 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 21:00:40,300 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 21:00:40,300 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:40,301 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:40,301 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:00:40,301 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:40,302 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:40,302 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:00:40,303 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:00:40,409 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0004_000001 (auth:SIMPLE) 2023-09-12 21:00:40,638 WARN [Listener at jenkins-hbase9.apache.org/32837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 21:00:40,640 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-12 21:00:40,642 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-12 21:00:40,694 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 21:00:40,695 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 21:00:41,392 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 21:00:41,412 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0005_000001 (auth:SIMPLE) 2023-09-12 21:00:44,972 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0005_000001 (auth:SIMPLE) 2023-09-12 21:00:47,189 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0005_000001 (auth:SIMPLE) 2023-09-12 21:00:49,347 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0005_000001 (auth:SIMPLE) 2023-09-12 21:00:50,802 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 21:00:50,805 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 21:00:50,814 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:50,814 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 21:00:50,814 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 21:00:50,815 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-480281790_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:50,815 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-12 21:00:50,815 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-12 21:00:50,815 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-480281790_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552439337/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552439337/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:50,816 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552439337/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-12 21:00:50,816 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552439337/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-12 21:00:50,821 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:50,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:50,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:50,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-12 21:00:50,825 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552450825"}]},"ts":"1694552450825"} 2023-09-12 21:00:50,826 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-12 21:00:50,829 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-12 21:00:50,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e4bec80bafd025dcf5efb74ab5dc148, UNASSIGN}] 2023-09-12 21:00:50,831 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e4bec80bafd025dcf5efb74ab5dc148, UNASSIGN 2023-09-12 21:00:50,832 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=1e4bec80bafd025dcf5efb74ab5dc148, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:50,832 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694552450832"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552450832"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552450832"}]},"ts":"1694552450832"} 2023-09-12 21:00:50,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 1e4bec80bafd025dcf5efb74ab5dc148, server=jenkins-hbase9.apache.org,34031,1694552367245}] 2023-09-12 21:00:50,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-12 21:00:50,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 1e4bec80bafd025dcf5efb74ab5dc148 2023-09-12 21:00:50,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1e4bec80bafd025dcf5efb74ab5dc148, disabling compactions & flushes 2023-09-12 21:00:50,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148. 2023-09-12 21:00:50,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148. 2023-09-12 21:00:50,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148. after waiting 0 ms 2023-09-12 21:00:50,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148. 2023-09-12 21:00:50,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-12 21:00:50,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:00:50,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148. 2023-09-12 21:00:50,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1e4bec80bafd025dcf5efb74ab5dc148: 2023-09-12 21:00:50,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 1e4bec80bafd025dcf5efb74ab5dc148 2023-09-12 21:00:50,997 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=1e4bec80bafd025dcf5efb74ab5dc148, regionState=CLOSED 2023-09-12 21:00:50,997 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694552450997"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552450997"}]},"ts":"1694552450997"} 2023-09-12 21:00:51,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-12 21:00:51,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 1e4bec80bafd025dcf5efb74ab5dc148, server=jenkins-hbase9.apache.org,34031,1694552367245 in 165 msec 2023-09-12 21:00:51,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-12 21:00:51,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1e4bec80bafd025dcf5efb74ab5dc148, UNASSIGN in 171 msec 2023-09-12 21:00:51,002 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552451002"}]},"ts":"1694552451002"} 2023-09-12 21:00:51,003 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-12 21:00:51,004 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-12 21:00:51,005 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 183 msec 2023-09-12 21:00:51,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-12 21:00:51,127 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-12 21:00:51,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,131 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,131 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,133 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,135 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:51,135 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148 2023-09-12 21:00:51,135 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,135 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,136 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,135 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:51,135 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-12 21:00:51,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-12 21:00:51,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-12 21:00:51,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-12 21:00:51,137 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/recovered.edits] 2023-09-12 21:00:51,137 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/recovered.edits] 2023-09-12 21:00:51,138 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/recovered.edits] 2023-09-12 21:00:51,139 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,139 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,139 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,139 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:51,139 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:51,139 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:51,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:51,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:51,140 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,140 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:51,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-12 21:00:51,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:51,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:51,143 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/cf/9473646956c74d7996dd2229330f4edd to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/cf/9473646956c74d7996dd2229330f4edd 2023-09-12 21:00:51,143 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/cf/9473646956c74d7996dd2229330f4edd.31b563b1024e7dabe77a5c0205429ae5 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/cf/9473646956c74d7996dd2229330f4edd.31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:51,144 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/cf/ed1a4e64d0fa440e83ab93d59b45a991 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/cf/ed1a4e64d0fa440e83ab93d59b45a991 2023-09-12 21:00:51,145 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/cf/ed1a4e64d0fa440e83ab93d59b45a991.bce76dc0bf0ad762ec93da7cd548ed31 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/cf/ed1a4e64d0fa440e83ab93d59b45a991.bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:51,149 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/recovered.edits/8.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5/recovered.edits/8.seqid 2023-09-12 21:00:51,150 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/recovered.edits/8.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31/recovered.edits/8.seqid 2023-09-12 21:00:51,150 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31b563b1024e7dabe77a5c0205429ae5 2023-09-12 21:00:51,150 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bce76dc0bf0ad762ec93da7cd548ed31 2023-09-12 21:00:51,151 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/recovered.edits/12.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148/recovered.edits/12.seqid 2023-09-12 21:00:51,151 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1e4bec80bafd025dcf5efb74ab5dc148 2023-09-12 21:00:51,151 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-12 21:00:51,153 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,155 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-12 21:00:51,157 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-12 21:00:51,157 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,157 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-12 21:00:51,157 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694552451157"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:51,159 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-12 21:00:51,159 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1e4bec80bafd025dcf5efb74ab5dc148, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694552437459.1e4bec80bafd025dcf5efb74ab5dc148.', STARTKEY => '', ENDKEY => ''}] 2023-09-12 21:00:51,159 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-12 21:00:51,159 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694552451159"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:51,160 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-12 21:00:51,162 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 34 msec 2023-09-12 21:00:51,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-12 21:00:51,242 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-12 21:00:51,243 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-12 21:00:51,247 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552451247"}]},"ts":"1694552451247"} 2023-09-12 21:00:51,248 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-12 21:00:51,250 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-12 21:00:51,251 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75c66e51e2ec4f94b5545735dece68ae, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=598af0e5ec24d1fb47e07fc4fb367b85, UNASSIGN}] 2023-09-12 21:00:51,253 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75c66e51e2ec4f94b5545735dece68ae, UNASSIGN 2023-09-12 21:00:51,253 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=598af0e5ec24d1fb47e07fc4fb367b85, UNASSIGN 2023-09-12 21:00:51,253 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=75c66e51e2ec4f94b5545735dece68ae, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:51,253 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=598af0e5ec24d1fb47e07fc4fb367b85, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:51,253 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694552451253"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552451253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552451253"}]},"ts":"1694552451253"} 2023-09-12 21:00:51,253 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694552451253"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552451253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552451253"}]},"ts":"1694552451253"} 2023-09-12 21:00:51,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 75c66e51e2ec4f94b5545735dece68ae, server=jenkins-hbase9.apache.org,42813,1694552367323}] 2023-09-12 21:00:51,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 598af0e5ec24d1fb47e07fc4fb367b85, server=jenkins-hbase9.apache.org,45939,1694552367290}] 2023-09-12 21:00:51,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-12 21:00:51,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 598af0e5ec24d1fb47e07fc4fb367b85 2023-09-12 21:00:51,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 75c66e51e2ec4f94b5545735dece68ae 2023-09-12 21:00:51,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 598af0e5ec24d1fb47e07fc4fb367b85, disabling compactions & flushes 2023-09-12 21:00:51,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 75c66e51e2ec4f94b5545735dece68ae, disabling compactions & flushes 2023-09-12 21:00:51,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:51,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:51,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:51,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:51,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. after waiting 0 ms 2023-09-12 21:00:51,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:51,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. after waiting 0 ms 2023-09-12 21:00:51,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:51,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 21:00:51,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 21:00:51,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:00:51,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:00:51,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85. 2023-09-12 21:00:51,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae. 2023-09-12 21:00:51,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 598af0e5ec24d1fb47e07fc4fb367b85: 2023-09-12 21:00:51,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 75c66e51e2ec4f94b5545735dece68ae: 2023-09-12 21:00:51,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 598af0e5ec24d1fb47e07fc4fb367b85 2023-09-12 21:00:51,422 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=598af0e5ec24d1fb47e07fc4fb367b85, regionState=CLOSED 2023-09-12 21:00:51,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 75c66e51e2ec4f94b5545735dece68ae 2023-09-12 21:00:51,422 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694552451422"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552451422"}]},"ts":"1694552451422"} 2023-09-12 21:00:51,423 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=75c66e51e2ec4f94b5545735dece68ae, regionState=CLOSED 2023-09-12 21:00:51,423 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694552451423"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552451423"}]},"ts":"1694552451423"} 2023-09-12 21:00:51,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-12 21:00:51,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 598af0e5ec24d1fb47e07fc4fb367b85, server=jenkins-hbase9.apache.org,45939,1694552367290 in 168 msec 2023-09-12 21:00:51,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-12 21:00:51,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 75c66e51e2ec4f94b5545735dece68ae, server=jenkins-hbase9.apache.org,42813,1694552367323 in 169 msec 2023-09-12 21:00:51,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=598af0e5ec24d1fb47e07fc4fb367b85, UNASSIGN in 174 msec 2023-09-12 21:00:51,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-12 21:00:51,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=75c66e51e2ec4f94b5545735dece68ae, UNASSIGN in 175 msec 2023-09-12 21:00:51,427 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552451427"}]},"ts":"1694552451427"} 2023-09-12 21:00:51,428 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-12 21:00:51,430 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-12 21:00:51,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 187 msec 2023-09-12 21:00:51,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-12 21:00:51,548 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-12 21:00:51,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,551 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,552 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,553 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,555 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae 2023-09-12 21:00:51,555 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85 2023-09-12 21:00:51,556 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,556 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,556 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,556 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,557 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-12 21:00:51,557 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-12 21:00:51,557 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-12 21:00:51,557 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-12 21:00:51,557 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/recovered.edits] 2023-09-12 21:00:51,557 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/recovered.edits] 2023-09-12 21:00:51,558 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,558 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,558 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,558 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,558 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:51,558 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:51,558 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:51,558 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:51,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-12 21:00:51,562 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/cf/bd3236c58ab6456c96c52713b0200d23 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/cf/bd3236c58ab6456c96c52713b0200d23 2023-09-12 21:00:51,562 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/cf/5bca22b341c346069698acb81ca728e5 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/cf/5bca22b341c346069698acb81ca728e5 2023-09-12 21:00:51,564 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/recovered.edits/9.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85/recovered.edits/9.seqid 2023-09-12 21:00:51,564 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/recovered.edits/9.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae/recovered.edits/9.seqid 2023-09-12 21:00:51,565 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/598af0e5ec24d1fb47e07fc4fb367b85 2023-09-12 21:00:51,565 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/75c66e51e2ec4f94b5545735dece68ae 2023-09-12 21:00:51,565 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-12 21:00:51,565 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-12 21:00:51,566 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-12 21:00:51,569 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230912be2ca7a02ffb4dbd95fc0e793a3c33d0 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230912be2ca7a02ffb4dbd95fc0e793a3c33d0 2023-09-12 21:00:51,570 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309128d2016a26564448ea15608f46b7123f7 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309128d2016a26564448ea15608f46b7123f7 2023-09-12 21:00:51,570 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-12 21:00:51,572 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,574 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-12 21:00:51,575 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-12 21:00:51,576 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,576 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-12 21:00:51,576 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694552451576"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:51,577 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694552451576"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:51,578 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-12 21:00:51,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 75c66e51e2ec4f94b5545735dece68ae, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694552436111.75c66e51e2ec4f94b5545735dece68ae.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 598af0e5ec24d1fb47e07fc4fb367b85, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694552436111.598af0e5ec24d1fb47e07fc4fb367b85.', STARTKEY => '1', ENDKEY => ''}] 2023-09-12 21:00:51,578 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-12 21:00:51,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694552451578"}]},"ts":"9223372036854775807"} 2023-09-12 21:00:51,579 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-12 21:00:51,581 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 32 msec 2023-09-12 21:00:51,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-12 21:00:51,660 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-12 21:00:51,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-12 21:00:51,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-12 21:00:51,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 21:00:51,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-12 21:00:51,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 21:00:51,697 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 755) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (640167340) connection to jenkins-hbase9.apache.org/172.31.2.10:45591 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:38594 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2074270026_1 at /127.0.0.1:40990 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:41006 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3958 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2074270026_1 at /127.0.0.1:38928 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:38934 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=285 (was 287), ProcessCount=168 (was 168), AvailableMemoryMB=5782 (was 5848) 2023-09-12 21:00:51,697 WARN [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-09-12 21:00:51,715 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=285, ProcessCount=168, AvailableMemoryMB=5821 2023-09-12 21:00:51,715 WARN [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-09-12 21:00:51,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-12 21:00:51,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 21:00:51,719 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 21:00:51,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-12 21:00:51,720 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 21:00:51,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-12 21:00:51,722 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2 2023-09-12 21:00:51,722 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70 2023-09-12 21:00:51,722 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2 empty. 2023-09-12 21:00:51,722 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70 empty. 2023-09-12 21:00:51,722 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2 2023-09-12 21:00:51,722 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70 2023-09-12 21:00:51,723 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-12 21:00:51,730 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-12 21:00:51,731 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 751b358d3389a0ddcda2bc8b6fa10be2, NAME => 'testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 21:00:51,732 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 048d48bfd0a4cb01e8f636e871313a70, NAME => 'testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 21:00:51,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:51,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:51,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 751b358d3389a0ddcda2bc8b6fa10be2, disabling compactions & flushes 2023-09-12 21:00:51,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 048d48bfd0a4cb01e8f636e871313a70, disabling compactions & flushes 2023-09-12 21:00:51,741 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:00:51,741 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:00:51,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:00:51,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:00:51,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. after waiting 0 ms 2023-09-12 21:00:51,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. after waiting 0 ms 2023-09-12 21:00:51,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:00:51,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:00:51,741 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:00:51,741 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:00:51,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 751b358d3389a0ddcda2bc8b6fa10be2: 2023-09-12 21:00:51,741 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 048d48bfd0a4cb01e8f636e871313a70: 2023-09-12 21:00:51,743 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 21:00:51,744 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694552451744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552451744"}]},"ts":"1694552451744"} 2023-09-12 21:00:51,744 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694552451744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552451744"}]},"ts":"1694552451744"} 2023-09-12 21:00:51,746 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 21:00:51,746 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 21:00:51,746 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552451746"}]},"ts":"1694552451746"} 2023-09-12 21:00:51,747 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-12 21:00:51,752 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-12 21:00:51,752 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 21:00:51,752 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 21:00:51,752 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 21:00:51,753 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 21:00:51,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=751b358d3389a0ddcda2bc8b6fa10be2, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=048d48bfd0a4cb01e8f636e871313a70, ASSIGN}] 2023-09-12 21:00:51,754 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=048d48bfd0a4cb01e8f636e871313a70, ASSIGN 2023-09-12 21:00:51,754 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=751b358d3389a0ddcda2bc8b6fa10be2, ASSIGN 2023-09-12 21:00:51,755 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=048d48bfd0a4cb01e8f636e871313a70, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45939,1694552367290; forceNewPlan=false, retain=false 2023-09-12 21:00:51,755 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=751b358d3389a0ddcda2bc8b6fa10be2, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42813,1694552367323; forceNewPlan=false, retain=false 2023-09-12 21:00:51,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-12 21:00:51,905 INFO [jenkins-hbase9:38453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 21:00:51,907 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=048d48bfd0a4cb01e8f636e871313a70, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:51,907 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=751b358d3389a0ddcda2bc8b6fa10be2, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:51,907 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694552451907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552451907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552451907"}]},"ts":"1694552451907"} 2023-09-12 21:00:51,908 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694552451907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552451907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552451907"}]},"ts":"1694552451907"} 2023-09-12 21:00:51,909 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 048d48bfd0a4cb01e8f636e871313a70, server=jenkins-hbase9.apache.org,45939,1694552367290}] 2023-09-12 21:00:51,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 751b358d3389a0ddcda2bc8b6fa10be2, server=jenkins-hbase9.apache.org,42813,1694552367323}] 2023-09-12 21:00:52,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-12 21:00:52,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:00:52,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 048d48bfd0a4cb01e8f636e871313a70, NAME => 'testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70.', STARTKEY => '1', ENDKEY => ''} 2023-09-12 21:00:52,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. service=AccessControlService 2023-09-12 21:00:52,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 21:00:52,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 048d48bfd0a4cb01e8f636e871313a70 2023-09-12 21:00:52,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:52,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 048d48bfd0a4cb01e8f636e871313a70 2023-09-12 21:00:52,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 048d48bfd0a4cb01e8f636e871313a70 2023-09-12 21:00:52,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:00:52,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 751b358d3389a0ddcda2bc8b6fa10be2, NAME => 'testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2.', STARTKEY => '', ENDKEY => '1'} 2023-09-12 21:00:52,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. service=AccessControlService 2023-09-12 21:00:52,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 21:00:52,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 751b358d3389a0ddcda2bc8b6fa10be2 2023-09-12 21:00:52,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:00:52,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 751b358d3389a0ddcda2bc8b6fa10be2 2023-09-12 21:00:52,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 751b358d3389a0ddcda2bc8b6fa10be2 2023-09-12 21:00:52,065 INFO [StoreOpener-048d48bfd0a4cb01e8f636e871313a70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 048d48bfd0a4cb01e8f636e871313a70 2023-09-12 21:00:52,065 INFO [StoreOpener-751b358d3389a0ddcda2bc8b6fa10be2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 751b358d3389a0ddcda2bc8b6fa10be2 2023-09-12 21:00:52,066 DEBUG [StoreOpener-048d48bfd0a4cb01e8f636e871313a70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/cf 2023-09-12 21:00:52,066 DEBUG [StoreOpener-048d48bfd0a4cb01e8f636e871313a70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/cf 2023-09-12 21:00:52,066 INFO [StoreOpener-048d48bfd0a4cb01e8f636e871313a70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 048d48bfd0a4cb01e8f636e871313a70 columnFamilyName cf 2023-09-12 21:00:52,066 DEBUG [StoreOpener-751b358d3389a0ddcda2bc8b6fa10be2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/cf 2023-09-12 21:00:52,066 DEBUG [StoreOpener-751b358d3389a0ddcda2bc8b6fa10be2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/cf 2023-09-12 21:00:52,067 INFO [StoreOpener-751b358d3389a0ddcda2bc8b6fa10be2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 751b358d3389a0ddcda2bc8b6fa10be2 columnFamilyName cf 2023-09-12 21:00:52,067 INFO [StoreOpener-048d48bfd0a4cb01e8f636e871313a70-1] regionserver.HStore(310): Store=048d48bfd0a4cb01e8f636e871313a70/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 21:00:52,068 INFO [StoreOpener-751b358d3389a0ddcda2bc8b6fa10be2-1] regionserver.HStore(310): Store=751b358d3389a0ddcda2bc8b6fa10be2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 21:00:52,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70 2023-09-12 21:00:52,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70 2023-09-12 21:00:52,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2 2023-09-12 21:00:52,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2 2023-09-12 21:00:52,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 048d48bfd0a4cb01e8f636e871313a70 2023-09-12 21:00:52,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 751b358d3389a0ddcda2bc8b6fa10be2 2023-09-12 21:00:52,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 21:00:52,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 21:00:52,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 048d48bfd0a4cb01e8f636e871313a70; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72891198, jitterRate=0.0861634910106659}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 21:00:52,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 048d48bfd0a4cb01e8f636e871313a70: 2023-09-12 21:00:52,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 751b358d3389a0ddcda2bc8b6fa10be2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68548597, jitterRate=0.021453693509101868}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 21:00:52,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70., pid=93, masterSystemTime=1694552452060 2023-09-12 21:00:52,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 751b358d3389a0ddcda2bc8b6fa10be2: 2023-09-12 21:00:52,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2., pid=94, masterSystemTime=1694552452061 2023-09-12 21:00:52,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:00:52,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:00:52,077 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=048d48bfd0a4cb01e8f636e871313a70, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:00:52,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:00:52,077 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694552452077"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552452077"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552452077"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552452077"}]},"ts":"1694552452077"} 2023-09-12 21:00:52,077 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=751b358d3389a0ddcda2bc8b6fa10be2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,078 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694552452077"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552452077"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552452077"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552452077"}]},"ts":"1694552452077"} 2023-09-12 21:00:52,080 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-12 21:00:52,080 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 048d48bfd0a4cb01e8f636e871313a70, server=jenkins-hbase9.apache.org,45939,1694552367290 in 169 msec 2023-09-12 21:00:52,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-12 21:00:52,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 751b358d3389a0ddcda2bc8b6fa10be2, server=jenkins-hbase9.apache.org,42813,1694552367323 in 170 msec 2023-09-12 21:00:52,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=048d48bfd0a4cb01e8f636e871313a70, ASSIGN in 327 msec 2023-09-12 21:00:52,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-12 21:00:52,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=751b358d3389a0ddcda2bc8b6fa10be2, ASSIGN in 328 msec 2023-09-12 21:00:52,083 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 21:00:52,083 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552452083"}]},"ts":"1694552452083"} 2023-09-12 21:00:52,084 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-12 21:00:52,086 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 21:00:52,086 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-12 21:00:52,088 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-12 21:00:52,089 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:52,089 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:52,089 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:52,089 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:00:52,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:52,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:52,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:52,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 21:00:52,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 374 msec 2023-09-12 21:00:52,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-12 21:00:52,323 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-12 21:00:52,325 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-12 21:00:52,325 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:00:52,326 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 21:00:52,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 21:00:52,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694552452337 (current time:1694552452337). 2023-09-12 21:00:52,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 21:00:52,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x673e9dbb to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:52,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7132a77a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:52,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:52,348 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:52,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x673e9dbb to 127.0.0.1:58083 2023-09-12 21:00:52,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:52,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x7c19bc84 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:52,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f5935f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:52,355 DEBUG [hconnection-0xb34461f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:52,357 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:52,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:52,363 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:52,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c19bc84 to 127.0.0.1:58083 2023-09-12 21:00:52,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:52,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-12 21:00:52,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 21:00:52,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 21:00:52,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-12 21:00:52,367 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-12 21:00:52,367 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694553052367 2023-09-12 21:00:52,367 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-12 21:00:52,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 21:00:52,368 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 21:00:52,369 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 21:00:52,369 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-12 21:00:52,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-12 21:00:52,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-12 21:00:52,373 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-12 21:00:52,374 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694553052374 2023-09-12 21:00:52,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,385 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-12 21:00:52,385 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:52,386 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-12 21:00:52,386 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-12 21:00:52,386 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,386 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,392 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:52,392 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:52,392 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:52,392 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:52,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:52,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:52,393 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:52,393 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,393 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,393 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 21:00:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-12 21:00:52,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-12 21:00:52,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-12 21:00:52,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,394 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-12 21:00:52,394 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-12 21:00:52,394 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-12 21:00:52,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,394 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-12 21:00:52,394 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-12 21:00:52,394 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:52,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,395 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-12 21:00:52,395 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-12 21:00:52,395 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-12 21:00:52,395 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:52,394 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:52,396 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-12 21:00:52,397 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-12 21:00:52,397 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-12 21:00:52,397 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-12 21:00:52,395 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-12 21:00:52,397 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-12 21:00:52,397 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-12 21:00:52,398 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,398 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,398 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:52,398 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:52,400 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,400 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,400 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,400 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:52,400 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,400 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:52,400 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:52,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-12 21:00:52,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bb9cc21[Count = 1] remaining members to acquire global barrier 2023-09-12 21:00:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:52,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:52,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:52,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-12 21:00:52,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bb9cc21[Count = 0] remaining members to acquire global barrier 2023-09-12 21:00:52,404 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-12 21:00:52,405 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,406 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,406 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,406 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,406 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-12 21:00:52,406 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,406 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-12 21:00:52,406 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:00:52,406 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:00:52,406 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:00:52,406 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,406 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. started... 2023-09-12 21:00:52,406 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-12 21:00:52,406 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 21:00:52,406 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-12 21:00:52,406 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:00:52,407 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:00:52,406 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,34031,1694552367245' in zk 2023-09-12 21:00:52,407 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:00:52,406 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 751b358d3389a0ddcda2bc8b6fa10be2: 2023-09-12 21:00:52,407 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. started... 2023-09-12 21:00:52,407 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,407 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:00:52,408 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 048d48bfd0a4cb01e8f636e871313a70: 2023-09-12 21:00:52,408 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 21:00:52,408 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,408 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:00:52,408 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 21:00:52,409 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-12 21:00:52,409 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:52,409 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-12 21:00:52,423 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. completed. 2023-09-12 21:00:52,424 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:00:52,424 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. completed. 2023-09-12 21:00:52,424 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:00:52,424 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:00:52,424 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:00:52,424 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:00:52,424 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,424 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:00:52,424 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-12 21:00:52,424 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,424 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,42813,1694552367323' in zk 2023-09-12 21:00:52,424 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-12 21:00:52,424 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45939,1694552367290' in zk 2023-09-12 21:00:52,425 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-12 21:00:52,425 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,426 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:52,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:52,426 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-12 21:00:52,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:52,427 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,427 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-12 21:00:52,427 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:52,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:52,427 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-12 21:00:52,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:52,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:52,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,42813,1694552367323': 2023-09-12 21:00:52,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-12 21:00:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:52,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:52,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:52,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:52,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:52,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,45939,1694552367290': 2023-09-12 21:00:52,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-12 21:00:52,433 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-12 21:00:52,433 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 21:00:52,433 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 21:00:52,433 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,433 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 21:00:52,434 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,434 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:52,434 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,434 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,435 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,434 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:52,435 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:52,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:52,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:52,435 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,436 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:52,436 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:52,437 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,438 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,438 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,440 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,440 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:52,440 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:52,440 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:52,440 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:52,440 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:52,441 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:52,440 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:52,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:52,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:52,440 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,441 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:52,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:52,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:52,441 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-12 21:00:52,441 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:52,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:52,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 21:00:52,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:52,442 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:52,442 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:52,442 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,442 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,442 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,442 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,442 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,442 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-12 21:00:52,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:52,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:52,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,463 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-12 21:00:52,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,464 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694552452367Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694552452448 (+81 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694552452448Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1694552452448Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1694552452452 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694552452458 (+6 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694552452463 (+5 ms) 2023-09-12 21:00:52,466 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-12 21:00:52,467 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 98 msec 2023-09-12 21:00:52,469 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:00:52,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 21:00:52,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 21:00:52,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42813] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 21:00:52,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45939] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 21:00:52,475 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-12 21:00:52,475 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:00:52,475 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 21:00:52,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 21:00:52,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694552452484 (current time:1694552452484). 2023-09-12 21:00:52,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 21:00:52,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x1ba96151 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:52,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3204d885, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:52,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:52,493 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:52,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ba96151 to 127.0.0.1:58083 2023-09-12 21:00:52,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:52,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x601e1414 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:00:52,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30ed42af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:00:52,500 DEBUG [hconnection-0x24b964c7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:52,501 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:52,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:00:52,505 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:00:52,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x601e1414 to 127.0.0.1:58083 2023-09-12 21:00:52,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:00:52,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-12 21:00:52,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 21:00:52,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 21:00:52,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-12 21:00:52,509 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-12 21:00:52,509 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694553052509 2023-09-12 21:00:52,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 21:00:52,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-12 21:00:52,510 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 21:00:52,510 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 21:00:52,511 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-12 21:00:52,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-12 21:00:52,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-12 21:00:52,513 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-12 21:00:52,513 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694553052513 2023-09-12 21:00:52,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,525 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-12 21:00:52,526 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:52,526 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-12 21:00:52,527 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-12 21:00:52,527 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,527 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,528 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:52,528 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:52,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:52,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:52,528 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,528 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:52,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,529 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,529 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,529 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,530 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,530 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 21:00:52,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-12 21:00:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-12 21:00:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-12 21:00:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,531 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-12 21:00:52,531 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-12 21:00:52,531 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-12 21:00:52,531 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,531 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-12 21:00:52,531 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:52,537 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,538 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,538 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-12 21:00:52,538 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:52,538 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-12 21:00:52,539 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-12 21:00:52,539 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-12 21:00:52,538 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-12 21:00:52,539 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-12 21:00:52,539 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-12 21:00:52,539 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:00:52,539 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-12 21:00:52,542 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-12 21:00:52,542 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-12 21:00:52,542 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-12 21:00:52,544 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,545 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:52,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:52,545 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,545 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:52,545 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,545 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,545 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:52,546 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,546 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:52,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:52,546 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,546 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:00:52,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:52,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-12 21:00:52,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43952a7f[Count = 1] remaining members to acquire global barrier 2023-09-12 21:00:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:52,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-12 21:00:52,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43952a7f[Count = 0] remaining members to acquire global barrier 2023-09-12 21:00:52,550 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-12 21:00:52,550 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,553 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,553 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,553 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,554 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-12 21:00:52,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,553 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,554 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:00:52,554 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:00:52,554 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:00:52,554 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. started... 2023-09-12 21:00:52,553 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-12 21:00:52,554 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-12 21:00:52,554 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-12 21:00:52,554 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,34031,1694552367245' in zk 2023-09-12 21:00:52,554 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:00:52,554 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:00:52,554 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,554 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 21:00:52,554 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:00:52,554 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 048d48bfd0a4cb01e8f636e871313a70 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-12 21:00:52,554 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. started... 2023-09-12 21:00:52,555 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 751b358d3389a0ddcda2bc8b6fa10be2 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-12 21:00:52,557 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-12 21:00:52,557 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:52,557 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-12 21:00:52,580 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230912c69c3c08627b46dd9c04b2856ad746ef to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230912c69c3c08627b46dd9c04b2856ad746ef 2023-09-12 21:00:52,580 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309126b170735181e4d0d9239f44be0e32d10 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309126b170735181e4d0d9239f44be0e32d10 2023-09-12 21:00:52,592 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/.tmp/cf/2a97bb62aca141b7b3be85587b4e997f 2023-09-12 21:00:52,595 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/.tmp/cf/01dfe90a25de40c9b028a5d2f4bc07a4 2023-09-12 21:00:52,597 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/.tmp/cf/2a97bb62aca141b7b3be85587b4e997f as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/cf/2a97bb62aca141b7b3be85587b4e997f 2023-09-12 21:00:52,601 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/.tmp/cf/01dfe90a25de40c9b028a5d2f4bc07a4 as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/cf/01dfe90a25de40c9b028a5d2f4bc07a4 2023-09-12 21:00:52,602 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/cf/2a97bb62aca141b7b3be85587b4e997f, entries=44, sequenceid=6, filesize=12.6 K 2023-09-12 21:00:52,602 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 048d48bfd0a4cb01e8f636e871313a70 in 48ms, sequenceid=6, compaction requested=false 2023-09-12 21:00:52,603 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-12 21:00:52,603 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 048d48bfd0a4cb01e8f636e871313a70: 2023-09-12 21:00:52,603 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,603 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:00:52,603 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/cf/2a97bb62aca141b7b3be85587b4e997f] hfiles 2023-09-12 21:00:52,603 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/cf/2a97bb62aca141b7b3be85587b4e997f for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,606 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/cf/01dfe90a25de40c9b028a5d2f4bc07a4, entries=6, sequenceid=6, filesize=5.9 K 2023-09-12 21:00:52,607 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 751b358d3389a0ddcda2bc8b6fa10be2 in 52ms, sequenceid=6, compaction requested=false 2023-09-12 21:00:52,609 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 751b358d3389a0ddcda2bc8b6fa10be2: 2023-09-12 21:00:52,609 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,609 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:00:52,609 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/cf/01dfe90a25de40c9b028a5d2f4bc07a4] hfiles 2023-09-12 21:00:52,609 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/cf/01dfe90a25de40c9b028a5d2f4bc07a4 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,610 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:00:52,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 21:00:52,612 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. completed. 2023-09-12 21:00:52,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-12 21:00:52,612 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:00:52,612 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:00:52,612 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:00:52,612 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,612 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 21:00:52,612 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-12 21:00:52,612 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45939,1694552367290' in zk 2023-09-12 21:00:52,614 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-12 21:00:52,614 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,614 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:52,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:52,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:52,614 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-12 21:00:52,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:52,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:52,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,617 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. completed. 2023-09-12 21:00:52,617 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:00:52,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,617 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:00:52,617 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:00:52,617 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,617 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-12 21:00:52,617 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,42813,1694552367323' in zk 2023-09-12 21:00:52,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:52,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,619 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-12 21:00:52,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,619 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:52,619 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,619 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-12 21:00:52,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,45939,1694552367290': 2023-09-12 21:00:52,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-12 21:00:52,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:52,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:52,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:52,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:52,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:52,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,42813,1694552367323': 2023-09-12 21:00:52,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-12 21:00:52,624 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-12 21:00:52,624 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 21:00:52,624 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 21:00:52,624 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,624 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 21:00:52,626 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,626 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,626 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:52,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:00:52,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:00:52,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,626 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,626 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,626 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:52,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:00:52,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,626 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:52,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:52,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:52,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:52,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:52,627 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:52,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:52,627 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:00:52,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,628 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:00:52,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,629 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,629 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,630 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,632 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,633 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,633 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,633 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:52,633 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:52,633 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:52,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:52,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:52,633 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:52,633 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:00:52,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:52,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:52,633 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:52,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:52,633 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-12 21:00:52,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:00:52,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:00:52,633 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:00:52,633 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:00:52,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:52,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:52,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,633 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:00:52,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:00:52,634 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:00:52,634 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:00:52,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 21:00:52,635 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:00:52,635 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,635 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309126b170735181e4d0d9239f44be0e32d10, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230912c69c3c08627b46dd9c04b2856ad746ef] mob files 2023-09-12 21:00:52,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309126b170735181e4d0d9239f44be0e32d10 2023-09-12 21:00:52,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230912c69c3c08627b46dd9c04b2856ad746ef 2023-09-12 21:00:52,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,658 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-12 21:00:52,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,658 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694552452509Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694552452641 (+132 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1694552452641Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1694552452641Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1694552452643 (+2 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1694552452649 (+6 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694552452658 (+9 ms) 2023-09-12 21:00:52,663 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-12 21:00:52,664 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 153 msec 2023-09-12 21:00:52,812 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:00:52,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 21:00:52,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 21:00:52,813 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552452813 2023-09-12 21:00:52,813 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38861, tgtDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552452813, rawTgtDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552452813, srcFsUri=hdfs://localhost:38861, srcDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 21:00:52,834 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 21:00:52,835 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_772750951_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552452813, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552452813/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,835 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944, snapshotDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-12 21:00:52,839 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552452813/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:00:52,857 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:52,857 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:52,857 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:52,858 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:53,723 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-2382959175701864598.jar 2023-09-12 21:00:53,724 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:53,724 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:53,788 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-1505506144012397434.jar 2023-09-12 21:00:53,788 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:53,789 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:53,789 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:53,789 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:53,790 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:53,790 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 21:00:53,790 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 21:00:53,790 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 21:00:53,791 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 21:00:53,791 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 21:00:53,791 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 21:00:53,792 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 21:00:53,792 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 21:00:53,792 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 21:00:53,793 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 21:00:53,793 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 21:00:53,794 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:53,794 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:53,795 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:00:53,795 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:53,795 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:00:53,795 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:00:53,796 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:00:54,138 WARN [Listener at jenkins-hbase9.apache.org/32837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 21:00:54,140 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-12 21:00:55,514 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 21:00:55,514 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 21:00:55,516 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0005_000001 (auth:SIMPLE) 2023-09-12 21:00:55,570 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0006_000001 (auth:SIMPLE) 2023-09-12 21:00:56,602 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 21:00:59,143 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0006_000001 (auth:SIMPLE) 2023-09-12 21:01:01,471 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 21:01:01,471 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 21:01:01,476 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:01:01,476 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 21:01:01,476 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 21:01:01,477 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-480281790_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:01:01,477 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-12 21:01:01,477 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-12 21:01:01,477 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-480281790_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552452813/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552452813/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:01:01,478 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552452813/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-12 21:01:01,478 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552452813/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-12 21:01:01,482 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-12 21:01:01,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552461487"}]},"ts":"1694552461487"} 2023-09-12 21:01:01,488 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-12 21:01:01,490 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-12 21:01:01,490 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=751b358d3389a0ddcda2bc8b6fa10be2, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=048d48bfd0a4cb01e8f636e871313a70, UNASSIGN}] 2023-09-12 21:01:01,492 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=048d48bfd0a4cb01e8f636e871313a70, UNASSIGN 2023-09-12 21:01:01,492 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=751b358d3389a0ddcda2bc8b6fa10be2, UNASSIGN 2023-09-12 21:01:01,493 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=048d48bfd0a4cb01e8f636e871313a70, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:01,493 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=751b358d3389a0ddcda2bc8b6fa10be2, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:01,493 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694552461493"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552461493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552461493"}]},"ts":"1694552461493"} 2023-09-12 21:01:01,493 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694552461493"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552461493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552461493"}]},"ts":"1694552461493"} 2023-09-12 21:01:01,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 048d48bfd0a4cb01e8f636e871313a70, server=jenkins-hbase9.apache.org,45939,1694552367290}] 2023-09-12 21:01:01,494 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 751b358d3389a0ddcda2bc8b6fa10be2, server=jenkins-hbase9.apache.org,42813,1694552367323}] 2023-09-12 21:01:01,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-12 21:01:01,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 048d48bfd0a4cb01e8f636e871313a70 2023-09-12 21:01:01,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 048d48bfd0a4cb01e8f636e871313a70, disabling compactions & flushes 2023-09-12 21:01:01,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:01:01,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:01:01,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. after waiting 0 ms 2023-09-12 21:01:01,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:01:01,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 751b358d3389a0ddcda2bc8b6fa10be2 2023-09-12 21:01:01,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 751b358d3389a0ddcda2bc8b6fa10be2, disabling compactions & flushes 2023-09-12 21:01:01,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:01:01,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:01:01,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. after waiting 0 ms 2023-09-12 21:01:01,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:01:01,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 21:01:01,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 21:01:01,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:01,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70. 2023-09-12 21:01:01,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 048d48bfd0a4cb01e8f636e871313a70: 2023-09-12 21:01:01,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:01,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2. 2023-09-12 21:01:01,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 751b358d3389a0ddcda2bc8b6fa10be2: 2023-09-12 21:01:01,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 048d48bfd0a4cb01e8f636e871313a70 2023-09-12 21:01:01,659 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=048d48bfd0a4cb01e8f636e871313a70, regionState=CLOSED 2023-09-12 21:01:01,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 751b358d3389a0ddcda2bc8b6fa10be2 2023-09-12 21:01:01,659 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694552461659"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552461659"}]},"ts":"1694552461659"} 2023-09-12 21:01:01,659 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=751b358d3389a0ddcda2bc8b6fa10be2, regionState=CLOSED 2023-09-12 21:01:01,660 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694552461659"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552461659"}]},"ts":"1694552461659"} 2023-09-12 21:01:01,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-12 21:01:01,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 048d48bfd0a4cb01e8f636e871313a70, server=jenkins-hbase9.apache.org,45939,1694552367290 in 166 msec 2023-09-12 21:01:01,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-12 21:01:01,663 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 751b358d3389a0ddcda2bc8b6fa10be2, server=jenkins-hbase9.apache.org,42813,1694552367323 in 167 msec 2023-09-12 21:01:01,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=048d48bfd0a4cb01e8f636e871313a70, UNASSIGN in 172 msec 2023-09-12 21:01:01,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-12 21:01:01,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=751b358d3389a0ddcda2bc8b6fa10be2, UNASSIGN in 173 msec 2023-09-12 21:01:01,664 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552461664"}]},"ts":"1694552461664"} 2023-09-12 21:01:01,665 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-12 21:01:01,667 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-12 21:01:01,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 184 msec 2023-09-12 21:01:01,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-12 21:01:01,789 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-12 21:01:01,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,792 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,793 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,795 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,797 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2 2023-09-12 21:01:01,797 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70 2023-09-12 21:01:01,798 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,798 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,798 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,798 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,798 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-12 21:01:01,798 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-12 21:01:01,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-12 21:01:01,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-12 21:01:01,799 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/recovered.edits] 2023-09-12 21:01:01,799 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/recovered.edits] 2023-09-12 21:01:01,800 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,800 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:01:01,800 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,800 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,800 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,800 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:01:01,800 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:01:01,800 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:01:01,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-12 21:01:01,804 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/cf/2a97bb62aca141b7b3be85587b4e997f to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/cf/2a97bb62aca141b7b3be85587b4e997f 2023-09-12 21:01:01,804 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/cf/01dfe90a25de40c9b028a5d2f4bc07a4 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/cf/01dfe90a25de40c9b028a5d2f4bc07a4 2023-09-12 21:01:01,807 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/recovered.edits/9.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70/recovered.edits/9.seqid 2023-09-12 21:01:01,807 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/recovered.edits/9.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2/recovered.edits/9.seqid 2023-09-12 21:01:01,808 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/048d48bfd0a4cb01e8f636e871313a70 2023-09-12 21:01:01,808 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testEmptyExportFileSystemState/751b358d3389a0ddcda2bc8b6fa10be2 2023-09-12 21:01:01,808 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-12 21:01:01,808 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-12 21:01:01,809 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-12 21:01:01,812 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309126b170735181e4d0d9239f44be0e32d10 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309126b170735181e4d0d9239f44be0e32d10 2023-09-12 21:01:01,813 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230912c69c3c08627b46dd9c04b2856ad746ef to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230912c69c3c08627b46dd9c04b2856ad746ef 2023-09-12 21:01:01,814 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-12 21:01:01,816 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,818 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-12 21:01:01,819 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-12 21:01:01,820 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,821 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-12 21:01:01,821 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694552461821"}]},"ts":"9223372036854775807"} 2023-09-12 21:01:01,821 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694552461821"}]},"ts":"9223372036854775807"} 2023-09-12 21:01:01,822 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-12 21:01:01,822 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 751b358d3389a0ddcda2bc8b6fa10be2, NAME => 'testtb-testEmptyExportFileSystemState,,1694552451717.751b358d3389a0ddcda2bc8b6fa10be2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 048d48bfd0a4cb01e8f636e871313a70, NAME => 'testtb-testEmptyExportFileSystemState,1,1694552451717.048d48bfd0a4cb01e8f636e871313a70.', STARTKEY => '1', ENDKEY => ''}] 2023-09-12 21:01:01,823 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-12 21:01:01,823 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694552461823"}]},"ts":"9223372036854775807"} 2023-09-12 21:01:01,824 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-12 21:01:01,826 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 21:01:01,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 37 msec 2023-09-12 21:01:01,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-12 21:01:01,902 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-12 21:01:01,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-12 21:01:01,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 21:01:01,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-12 21:01:01,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-12 21:01:01,938 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 761) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:36310 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_560269481_1 at /127.0.0.1:36296 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:60750 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (640167340) connection to jenkins-hbase9.apache.org/172.31.2.10:34121 from appattempt_1694552373675_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_560269481_1 at /127.0.0.1:60700 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:37676 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (640167340) connection to jenkins-hbase9.apache.org/172.31.2.10:43621 from appattempt_1694552373675_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (640167340) connection to jenkins-hbase9.apache.org/172.31.2.10:43353 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4608 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=944 (was 919) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=302 (was 285) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=5740 (was 5821) 2023-09-12 21:01:01,938 WARN [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-12 21:01:01,959 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=944, MaxFileDescriptor=60000, SystemLoadAverage=302, ProcessCount=168, AvailableMemoryMB=5736 2023-09-12 21:01:01,959 WARN [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-12 21:01:01,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-12 21:01:01,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:01,964 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 21:01:01,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-12 21:01:01,965 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 21:01:01,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-12 21:01:01,967 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa 2023-09-12 21:01:01,967 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67 2023-09-12 21:01:01,968 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa empty. 2023-09-12 21:01:01,968 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67 empty. 2023-09-12 21:01:01,969 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa 2023-09-12 21:01:01,969 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67 2023-09-12 21:01:01,969 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-12 21:01:01,978 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-12 21:01:01,979 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 741b8581a5ae56a69b3f59dc2dd4d6aa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 21:01:01,979 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => b69ea3f104679d1488f58d79f7a86a67, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp 2023-09-12 21:01:01,996 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:01:01,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 741b8581a5ae56a69b3f59dc2dd4d6aa, disabling compactions & flushes 2023-09-12 21:01:01,997 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:01,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:01,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. after waiting 0 ms 2023-09-12 21:01:01,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:01,997 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:01,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 741b8581a5ae56a69b3f59dc2dd4d6aa: 2023-09-12 21:01:01,999 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:01:01,999 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing b69ea3f104679d1488f58d79f7a86a67, disabling compactions & flushes 2023-09-12 21:01:01,999 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:01,999 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:01,999 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. after waiting 0 ms 2023-09-12 21:01:01,999 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:01,999 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:01,999 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for b69ea3f104679d1488f58d79f7a86a67: 2023-09-12 21:01:02,001 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 21:01:02,002 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694552462002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552462002"}]},"ts":"1694552462002"} 2023-09-12 21:01:02,002 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694552462002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552462002"}]},"ts":"1694552462002"} 2023-09-12 21:01:02,004 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 21:01:02,004 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 21:01:02,005 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552462004"}]},"ts":"1694552462004"} 2023-09-12 21:01:02,006 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-12 21:01:02,010 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-12 21:01:02,011 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 21:01:02,011 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 21:01:02,011 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 21:01:02,011 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 21:01:02,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=741b8581a5ae56a69b3f59dc2dd4d6aa, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b69ea3f104679d1488f58d79f7a86a67, ASSIGN}] 2023-09-12 21:01:02,013 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b69ea3f104679d1488f58d79f7a86a67, ASSIGN 2023-09-12 21:01:02,014 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=741b8581a5ae56a69b3f59dc2dd4d6aa, ASSIGN 2023-09-12 21:01:02,014 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b69ea3f104679d1488f58d79f7a86a67, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45939,1694552367290; forceNewPlan=false, retain=false 2023-09-12 21:01:02,014 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=741b8581a5ae56a69b3f59dc2dd4d6aa, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42813,1694552367323; forceNewPlan=false, retain=false 2023-09-12 21:01:02,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-12 21:01:02,164 INFO [jenkins-hbase9:38453] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 21:01:02,167 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=741b8581a5ae56a69b3f59dc2dd4d6aa, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,167 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b69ea3f104679d1488f58d79f7a86a67, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,167 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694552462167"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552462167"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552462167"}]},"ts":"1694552462167"} 2023-09-12 21:01:02,167 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694552462167"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552462167"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552462167"}]},"ts":"1694552462167"} 2023-09-12 21:01:02,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 741b8581a5ae56a69b3f59dc2dd4d6aa, server=jenkins-hbase9.apache.org,42813,1694552367323}] 2023-09-12 21:01:02,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure b69ea3f104679d1488f58d79f7a86a67, server=jenkins-hbase9.apache.org,45939,1694552367290}] 2023-09-12 21:01:02,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-12 21:01:02,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:02,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 741b8581a5ae56a69b3f59dc2dd4d6aa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa.', STARTKEY => '', ENDKEY => '1'} 2023-09-12 21:01:02,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. service=AccessControlService 2023-09-12 21:01:02,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:02,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b69ea3f104679d1488f58d79f7a86a67, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67.', STARTKEY => '1', ENDKEY => ''} 2023-09-12 21:01:02,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 21:01:02,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 741b8581a5ae56a69b3f59dc2dd4d6aa 2023-09-12 21:01:02,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:01:02,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. service=AccessControlService 2023-09-12 21:01:02,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 741b8581a5ae56a69b3f59dc2dd4d6aa 2023-09-12 21:01:02,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 741b8581a5ae56a69b3f59dc2dd4d6aa 2023-09-12 21:01:02,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 21:01:02,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp b69ea3f104679d1488f58d79f7a86a67 2023-09-12 21:01:02,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 21:01:02,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for b69ea3f104679d1488f58d79f7a86a67 2023-09-12 21:01:02,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for b69ea3f104679d1488f58d79f7a86a67 2023-09-12 21:01:02,325 INFO [StoreOpener-741b8581a5ae56a69b3f59dc2dd4d6aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 741b8581a5ae56a69b3f59dc2dd4d6aa 2023-09-12 21:01:02,326 INFO [StoreOpener-b69ea3f104679d1488f58d79f7a86a67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b69ea3f104679d1488f58d79f7a86a67 2023-09-12 21:01:02,327 DEBUG [StoreOpener-b69ea3f104679d1488f58d79f7a86a67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/cf 2023-09-12 21:01:02,327 DEBUG [StoreOpener-b69ea3f104679d1488f58d79f7a86a67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/cf 2023-09-12 21:01:02,327 DEBUG [StoreOpener-741b8581a5ae56a69b3f59dc2dd4d6aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/cf 2023-09-12 21:01:02,327 DEBUG [StoreOpener-741b8581a5ae56a69b3f59dc2dd4d6aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/cf 2023-09-12 21:01:02,327 INFO [StoreOpener-b69ea3f104679d1488f58d79f7a86a67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b69ea3f104679d1488f58d79f7a86a67 columnFamilyName cf 2023-09-12 21:01:02,327 INFO [StoreOpener-741b8581a5ae56a69b3f59dc2dd4d6aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 741b8581a5ae56a69b3f59dc2dd4d6aa columnFamilyName cf 2023-09-12 21:01:02,329 INFO [StoreOpener-b69ea3f104679d1488f58d79f7a86a67-1] regionserver.HStore(310): Store=b69ea3f104679d1488f58d79f7a86a67/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 21:01:02,329 INFO [StoreOpener-741b8581a5ae56a69b3f59dc2dd4d6aa-1] regionserver.HStore(310): Store=741b8581a5ae56a69b3f59dc2dd4d6aa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 21:01:02,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67 2023-09-12 21:01:02,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa 2023-09-12 21:01:02,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67 2023-09-12 21:01:02,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa 2023-09-12 21:01:02,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for b69ea3f104679d1488f58d79f7a86a67 2023-09-12 21:01:02,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 741b8581a5ae56a69b3f59dc2dd4d6aa 2023-09-12 21:01:02,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 21:01:02,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 21:01:02,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened b69ea3f104679d1488f58d79f7a86a67; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61340431, jitterRate=-0.08595634996891022}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 21:01:02,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for b69ea3f104679d1488f58d79f7a86a67: 2023-09-12 21:01:02,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 741b8581a5ae56a69b3f59dc2dd4d6aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70157694, jitterRate=0.04543110728263855}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 21:01:02,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 741b8581a5ae56a69b3f59dc2dd4d6aa: 2023-09-12 21:01:02,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67., pid=109, masterSystemTime=1694552462321 2023-09-12 21:01:02,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa., pid=108, masterSystemTime=1694552462320 2023-09-12 21:01:02,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:02,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:02,337 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=741b8581a5ae56a69b3f59dc2dd4d6aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:02,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:02,337 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694552462337"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552462337"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552462337"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552462337"}]},"ts":"1694552462337"} 2023-09-12 21:01:02,337 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b69ea3f104679d1488f58d79f7a86a67, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,338 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694552462337"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694552462337"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694552462337"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694552462337"}]},"ts":"1694552462337"} 2023-09-12 21:01:02,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-12 21:01:02,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 741b8581a5ae56a69b3f59dc2dd4d6aa, server=jenkins-hbase9.apache.org,42813,1694552367323 in 169 msec 2023-09-12 21:01:02,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-12 21:01:02,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure b69ea3f104679d1488f58d79f7a86a67, server=jenkins-hbase9.apache.org,45939,1694552367290 in 170 msec 2023-09-12 21:01:02,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=741b8581a5ae56a69b3f59dc2dd4d6aa, ASSIGN in 329 msec 2023-09-12 21:01:02,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-12 21:01:02,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b69ea3f104679d1488f58d79f7a86a67, ASSIGN in 329 msec 2023-09-12 21:01:02,342 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 21:01:02,342 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552462342"}]},"ts":"1694552462342"} 2023-09-12 21:01:02,343 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-12 21:01:02,345 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 21:01:02,345 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-12 21:01:02,347 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-12 21:01:02,348 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:01:02,348 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:01:02,348 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:01:02,348 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:01:02,349 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-12 21:01:02,350 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-12 21:01:02,350 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-12 21:01:02,350 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-12 21:01:02,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 389 msec 2023-09-12 21:01:02,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-12 21:01:02,569 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-12 21:01:02,571 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,571 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:02,572 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 21:01:02,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-12 21:01:02,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694552462582 (current time:1694552462582). 2023-09-12 21:01:02,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 21:01:02,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x6ed51533 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:01:02,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40655100, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:01:02,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:01:02,592 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:01:02,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ed51533 to 127.0.0.1:58083 2023-09-12 21:01:02,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:01:02,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x0c5efa45 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:01:02,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a641a70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:01:02,599 DEBUG [hconnection-0x2063bf6d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:01:02,601 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:01:02,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:01:02,606 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:01:02,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c5efa45 to 127.0.0.1:58083 2023-09-12 21:01:02,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:01:02,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-12 21:01:02,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 21:01:02,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-12 21:01:02,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-12 21:01:02,610 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-12 21:01:02,611 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694553062611 2023-09-12 21:01:02,611 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-12 21:01:02,612 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 21:01:02,612 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 21:01:02,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-12 21:01:02,613 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-12 21:01:02,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-12 21:01:02,615 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-12 21:01:02,615 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694553062615 2023-09-12 21:01:02,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,624 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-12 21:01:02,624 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:01:02,624 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-12 21:01:02,624 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-12 21:01:02,625 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,625 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,627 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:01:02,627 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:01:02,627 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:01:02,627 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:01:02,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:01:02,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:01:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:01:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:01:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:01:02,627 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,627 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,628 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,628 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 21:01:02,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-12 21:01:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-12 21:01:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-12 21:01:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,628 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-12 21:01:02,628 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-12 21:01:02,628 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-12 21:01:02,629 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,629 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,629 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-12 21:01:02,629 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-12 21:01:02,629 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,629 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:01:02,629 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-12 21:01:02,630 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:01:02,629 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:01:02,630 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-12 21:01:02,631 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-12 21:01:02,631 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-12 21:01:02,631 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-12 21:01:02,630 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-12 21:01:02,631 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-12 21:01:02,631 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-12 21:01:02,631 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-12 21:01:02,631 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-12 21:01:02,637 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,637 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:01:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:01:02,638 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,638 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:01:02,638 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,638 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:01:02,638 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,638 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,638 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:01:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:01:02,638 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,638 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:01:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:01:02,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-12 21:01:02,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a95eba0[Count = 1] remaining members to acquire global barrier 2023-09-12 21:01:02,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:01:02,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:01:02,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:01:02,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:01:02,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:01:02,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-12 21:01:02,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a95eba0[Count = 0] remaining members to acquire global barrier 2023-09-12 21:01:02,641 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-12 21:01:02,641 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,642 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,642 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,642 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,643 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-12 21:01:02,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,643 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-12 21:01:02,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,643 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,34031,1694552367245' in zk 2023-09-12 21:01:02,643 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-12 21:01:02,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,643 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,643 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:01:02,643 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:02,643 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-12 21:01:02,643 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. started... 2023-09-12 21:01:02,643 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:01:02,643 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,643 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 21:01:02,644 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b69ea3f104679d1488f58d79f7a86a67: 2023-09-12 21:01:02,643 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:01:02,644 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:01:02,644 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,644 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:02,644 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-12 21:01:02,644 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:01:02,644 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:01:02,644 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-12 21:01:02,644 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. started... 2023-09-12 21:01:02,645 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 21:01:02,645 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 741b8581a5ae56a69b3f59dc2dd4d6aa: 2023-09-12 21:01:02,645 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,645 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:01:02,645 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 21:01:02,652 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. completed. 2023-09-12 21:01:02,652 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:02,652 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:01:02,653 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:01:02,653 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,653 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-12 21:01:02,653 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,45939,1694552367290' in zk 2023-09-12 21:01:02,653 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. completed. 2023-09-12 21:01:02,653 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:02,653 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:01:02,653 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:01:02,653 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,653 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-12 21:01:02,653 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,42813,1694552367323' in zk 2023-09-12 21:01:02,655 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-12 21:01:02,655 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,655 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:01:02,655 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-12 21:01:02,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:01:02,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:01:02,656 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-12 21:01:02,656 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,656 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:01:02,656 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-12 21:01:02,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:01:02,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:01:02,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:01:02,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,45939,1694552367290': 2023-09-12 21:01:02,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-12 21:01:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:01:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:01:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:01:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:01:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:01:02,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,42813,1694552367323': 2023-09-12 21:01:02,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-12 21:01:02,664 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-12 21:01:02,664 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 21:01:02,664 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 21:01:02,664 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,664 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 21:01:02,666 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,666 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,666 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,666 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,666 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:01:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:01:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:01:02,666 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:01:02,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,666 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:01:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:01:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:01:02,666 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:01:02,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:01:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:01:02,667 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:01:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:01:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,668 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:01:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:01:02,669 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,670 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,670 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,672 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,672 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:01:02,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:01:02,672 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:01:02,673 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:01:02,672 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,673 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:01:02,673 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:01:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:01:02,673 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:01:02,673 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:01:02,672 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:01:02,674 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,674 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:01:02,674 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:01:02,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:01:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:01:02,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:01:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:01:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:01:02,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,674 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 21:01:02,674 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,674 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,674 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,674 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:01:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:01:02,674 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,675 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-12 21:01:02,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,703 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-12 21:01:02,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,704 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694552462611Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694552462683 (+72 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694552462683Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694552462684 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694552462687 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694552462698 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694552462703 (+5 ms) 2023-09-12 21:01:02,706 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-12 21:01:02,707 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 94 msec 2023-09-12 21:01:02,712 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:01:02,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-12 21:01:02,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 21:01:02,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42813] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 21:01:02,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45939] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 21:01:02,718 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,718 DEBUG [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:02,718 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 21:01:02,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-12 21:01:02,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694552462726 (current time:1694552462726). 2023-09-12 21:01:02,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 21:01:02,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x2edf48c6 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:01:02,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@137a12a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:01:02,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:01:02,735 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:01:02,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2edf48c6 to 127.0.0.1:58083 2023-09-12 21:01:02,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:01:02,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(139): Connect 0x5287ad87 to 127.0.0.1:58083 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 21:01:02,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64a4669, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 21:01:02,742 DEBUG [hconnection-0x45e6832d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:01:02,745 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:01:02,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 21:01:02,754 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 21:01:02,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5287ad87 to 127.0.0.1:58083 2023-09-12 21:01:02,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:01:02,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-12 21:01:02,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 21:01:02,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-12 21:01:02,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-12 21:01:02,758 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-12 21:01:02,759 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694553062759 2023-09-12 21:01:02,759 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-12 21:01:02,760 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 21:01:02,760 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 21:01:02,761 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-12 21:01:02,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-12 21:01:02,762 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-12 21:01:02,763 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-12 21:01:02,763 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694553062763 2023-09-12 21:01:02,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,776 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-12 21:01:02,776 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:01:02,777 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-12 21:01:02,777 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-12 21:01:02,777 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,777 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,780 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:01:02,780 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:01:02,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:01:02,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:01:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:01:02,780 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:01:02,780 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:01:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:01:02,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:01:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,781 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,781 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,781 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,781 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 21:01:02,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-12 21:01:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-12 21:01:02,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-12 21:01:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-12 21:01:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-12 21:01:02,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,782 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-12 21:01:02,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-12 21:01:02,782 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:01:02,782 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-12 21:01:02,782 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:01:02,783 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-12 21:01:02,784 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-12 21:01:02,784 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-12 21:01:02,784 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-12 21:01:02,784 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34031,1694552367245' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-12 21:01:02,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,784 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-12 21:01:02,784 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-12 21:01:02,784 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 21:01:02,785 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-12 21:01:02,785 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-12 21:01:02,785 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-12 21:01:02,786 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,786 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:01:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:01:02,786 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,787 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,787 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:01:02,787 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,787 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:01:02,787 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,787 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:01:02,787 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,787 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 21:01:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:01:02,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:01:02,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42813,1694552367323' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-12 21:01:02,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d8f00a0[Count = 1] remaining members to acquire global barrier 2023-09-12 21:01:02,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:01:02,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:01:02,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:01:02,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:01:02,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:01:02,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45939,1694552367290' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-12 21:01:02,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d8f00a0[Count = 0] remaining members to acquire global barrier 2023-09-12 21:01:02,791 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-12 21:01:02,791 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,796 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,796 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,796 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,796 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-12 21:01:02,796 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,796 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-12 21:01:02,796 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-12 21:01:02,796 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:01:02,797 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:01:02,797 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,797 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:02,797 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-12 21:01:02,797 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:02,797 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,34031,1694552367245' in zk 2023-09-12 21:01:02,797 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. started... 2023-09-12 21:01:02,797 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. started... 2023-09-12 21:01:02,797 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 21:01:02,797 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 21:01:02,797 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 21:01:02,797 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 741b8581a5ae56a69b3f59dc2dd4d6aa 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-12 21:01:02,797 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b69ea3f104679d1488f58d79f7a86a67 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-12 21:01:02,798 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-12 21:01:02,798 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:01:02,798 DEBUG [member: 'jenkins-hbase9.apache.org,34031,1694552367245' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-12 21:01:02,819 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230912e387c8da8e9e48f68de63218c3478f13 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230912e387c8da8e9e48f68de63218c3478f13 2023-09-12 21:01:02,819 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309121a8a06aecb3b4baa9b2f4d1d1799e5de to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309121a8a06aecb3b4baa9b2f4d1d1799e5de 2023-09-12 21:01:02,837 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/.tmp/cf/9b7c85f72c5446a2b26486caa94a5406 2023-09-12 21:01:02,837 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/.tmp/cf/430ca839110f497c99c2c667d424110e 2023-09-12 21:01:02,842 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/.tmp/cf/9b7c85f72c5446a2b26486caa94a5406 as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/cf/9b7c85f72c5446a2b26486caa94a5406 2023-09-12 21:01:02,842 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/.tmp/cf/430ca839110f497c99c2c667d424110e as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/cf/430ca839110f497c99c2c667d424110e 2023-09-12 21:01:02,846 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/cf/9b7c85f72c5446a2b26486caa94a5406, entries=3, sequenceid=6, filesize=5.4 K 2023-09-12 21:01:02,846 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/cf/430ca839110f497c99c2c667d424110e, entries=47, sequenceid=6, filesize=13.4 K 2023-09-12 21:01:02,847 INFO [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 741b8581a5ae56a69b3f59dc2dd4d6aa in 50ms, sequenceid=6, compaction requested=false 2023-09-12 21:01:02,847 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-12 21:01:02,847 INFO [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for b69ea3f104679d1488f58d79f7a86a67 in 50ms, sequenceid=6, compaction requested=false 2023-09-12 21:01:02,847 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-12 21:01:02,849 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 741b8581a5ae56a69b3f59dc2dd4d6aa: 2023-09-12 21:01:02,849 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b69ea3f104679d1488f58d79f7a86a67: 2023-09-12 21:01:02,850 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,850 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,850 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:01:02,850 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 21:01:02,850 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/cf/9b7c85f72c5446a2b26486caa94a5406] hfiles 2023-09-12 21:01:02,850 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/cf/430ca839110f497c99c2c667d424110e] hfiles 2023-09-12 21:01:02,850 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/cf/9b7c85f72c5446a2b26486caa94a5406 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,850 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/cf/430ca839110f497c99c2c667d424110e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,859 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. completed. 2023-09-12 21:01:02,859 DEBUG [rs(jenkins-hbase9.apache.org,42813,1694552367323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:02,859 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. completed. 2023-09-12 21:01:02,859 DEBUG [rs(jenkins-hbase9.apache.org,45939,1694552367290)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:02,859 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:01:02,859 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:01:02,859 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 21:01:02,859 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,860 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 21:01:02,860 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-12 21:01:02,860 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,860 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,42813,1694552367323' in zk 2023-09-12 21:01:02,860 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-12 21:01:02,860 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,45939,1694552367290' in zk 2023-09-12 21:01:02,861 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:01:02,862 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,862 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-12 21:01:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:01:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:01:02,862 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:01:02,862 DEBUG [member: 'jenkins-hbase9.apache.org,42813,1694552367323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-12 21:01:02,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-12 21:01:02,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-12 21:01:02,863 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-12 21:01:02,863 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,863 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:01:02,863 DEBUG [member: 'jenkins-hbase9.apache.org,45939,1694552367290' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-12 21:01:02,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:01:02,864 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 21:01:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:01:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:01:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,42813,1694552367323': 2023-09-12 21:01:02,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42813,1694552367323' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-12 21:01:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:01:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:01:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:01:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:01:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:01:02,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,45939,1694552367290': 2023-09-12 21:01:02,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45939,1694552367290' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-12 21:01:02,870 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-12 21:01:02,870 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 21:01:02,870 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 21:01:02,870 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,870 INFO [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 21:01:02,872 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,872 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,872 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:01:02,872 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:01:02,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,872 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,872 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 21:01:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 21:01:02,873 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:01:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:01:02,873 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 21:01:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:01:02,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:01:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:01:02,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:01:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:01:02,873 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,874 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 21:01:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 21:01:02,875 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,875 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,876 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,878 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,878 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:01:02,878 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:01:02,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:01:02,878 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 21:01:02,878 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:01:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:01:02,878 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:01:02,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:01:02,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 21:01:02,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 21:01:02,878 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:01:02,878 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 21:01:02,878 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,878 DEBUG [(jenkins-hbase9.apache.org,38453,1694552366017)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 21:01:02,878 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,879 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,879 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,880 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:01:02,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:01:02,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:01:02,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 21:01:02,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:01:02,880 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:02,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 21:01:02,880 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 21:01:02,880 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:02,880 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:02,880 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,880 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309121a8a06aecb3b4baa9b2f4d1d1799e5de, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230912e387c8da8e9e48f68de63218c3478f13] mob files 2023-09-12 21:01:02,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309121a8a06aecb3b4baa9b2f4d1d1799e5de 2023-09-12 21:01:02,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230912e387c8da8e9e48f68de63218c3478f13 2023-09-12 21:01:02,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,902 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-12 21:01:02,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,902 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:02,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694552462759Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694552462886 (+127 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694552462886Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1694552462886Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1694552462889 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694552462896 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694552462902 (+6 ms) 2023-09-12 21:01:02,904 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-12 21:01:02,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 144 msec 2023-09-12 21:01:03,064 DEBUG [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 21:01:03,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-12 21:01:03,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 21:01:03,066 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552463066 2023-09-12 21:01:03,066 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38861, tgtDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552463066, rawTgtDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552463066, srcFsUri=hdfs://localhost:38861, srcDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 21:01:03,087 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944 2023-09-12 21:01:03,087 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1961869593_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552463066, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552463066/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:03,087 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38861, inputRoot=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944, snapshotDir=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-12 21:01:03,096 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552463066/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:03,116 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 21:01:03,116 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 21:01:03,117 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 21:01:03,117 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 21:01:03,965 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-713271590990132584.jar 2023-09-12 21:01:03,966 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 21:01:03,966 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 21:01:04,030 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/hadoop-6459095728344684453.jar 2023-09-12 21:01:04,031 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 21:01:04,031 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 21:01:04,031 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 21:01:04,032 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 21:01:04,032 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 21:01:04,032 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 21:01:04,033 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 21:01:04,033 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 21:01:04,033 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 21:01:04,034 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 21:01:04,034 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 21:01:04,034 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 21:01:04,035 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 21:01:04,035 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 21:01:04,035 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 21:01:04,036 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 21:01:04,036 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:01:04,037 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:01:04,037 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:01:04,037 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:01:04,038 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 21:01:04,038 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:01:04,038 DEBUG [Listener at jenkins-hbase9.apache.org/32837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 21:01:04,373 WARN [Listener at jenkins-hbase9.apache.org/32837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 21:01:04,375 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-12 21:01:04,376 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-12 21:01:06,436 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 21:01:06,436 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 21:01:06,439 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0006_000001 (auth:SIMPLE) 2023-09-12 21:01:06,526 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0007_000001 (auth:SIMPLE) 2023-09-12 21:01:07,242 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 21:01:10,091 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0007_000001 (auth:SIMPLE) 2023-09-12 21:01:12,292 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0007_000001 (auth:SIMPLE) 2023-09-12 21:01:15,221 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694552373675_0007_000001 (auth:SIMPLE) 2023-09-12 21:01:16,527 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 21:01:16,527 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 21:01:16,537 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,538 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 21:01:16,538 INFO [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 21:01:16,538 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-480281790_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,539 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-12 21:01:16,539 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-12 21:01:16,539 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-480281790_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552463066/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552463066/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,539 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552463066/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-12 21:01:16,539 DEBUG [Listener at jenkins-hbase9.apache.org/32837] snapshot.TestExportSnapshot(367): hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/export-test/export-1694552463066/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-12 21:01:16,546 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-12 21:01:16,550 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552476550"}]},"ts":"1694552476550"} 2023-09-12 21:01:16,552 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-12 21:01:16,553 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-12 21:01:16,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=741b8581a5ae56a69b3f59dc2dd4d6aa, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b69ea3f104679d1488f58d79f7a86a67, UNASSIGN}] 2023-09-12 21:01:16,556 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b69ea3f104679d1488f58d79f7a86a67, UNASSIGN 2023-09-12 21:01:16,556 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=741b8581a5ae56a69b3f59dc2dd4d6aa, UNASSIGN 2023-09-12 21:01:16,557 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b69ea3f104679d1488f58d79f7a86a67, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:16,557 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694552476557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552476557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552476557"}]},"ts":"1694552476557"} 2023-09-12 21:01:16,557 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=741b8581a5ae56a69b3f59dc2dd4d6aa, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:16,557 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694552476557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694552476557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694552476557"}]},"ts":"1694552476557"} 2023-09-12 21:01:16,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure b69ea3f104679d1488f58d79f7a86a67, server=jenkins-hbase9.apache.org,45939,1694552367290}] 2023-09-12 21:01:16,559 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 741b8581a5ae56a69b3f59dc2dd4d6aa, server=jenkins-hbase9.apache.org,42813,1694552367323}] 2023-09-12 21:01:16,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-12 21:01:16,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close b69ea3f104679d1488f58d79f7a86a67 2023-09-12 21:01:16,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing b69ea3f104679d1488f58d79f7a86a67, disabling compactions & flushes 2023-09-12 21:01:16,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:16,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:16,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. after waiting 0 ms 2023-09-12 21:01:16,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:16,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 741b8581a5ae56a69b3f59dc2dd4d6aa 2023-09-12 21:01:16,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 741b8581a5ae56a69b3f59dc2dd4d6aa, disabling compactions & flushes 2023-09-12 21:01:16,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:16,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:16,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. after waiting 0 ms 2023-09-12 21:01:16,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:16,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 21:01:16,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:16,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 21:01:16,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67. 2023-09-12 21:01:16,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for b69ea3f104679d1488f58d79f7a86a67: 2023-09-12 21:01:16,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:16,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa. 2023-09-12 21:01:16,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 741b8581a5ae56a69b3f59dc2dd4d6aa: 2023-09-12 21:01:16,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed b69ea3f104679d1488f58d79f7a86a67 2023-09-12 21:01:16,726 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b69ea3f104679d1488f58d79f7a86a67, regionState=CLOSED 2023-09-12 21:01:16,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 741b8581a5ae56a69b3f59dc2dd4d6aa 2023-09-12 21:01:16,726 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694552476726"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552476726"}]},"ts":"1694552476726"} 2023-09-12 21:01:16,726 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=741b8581a5ae56a69b3f59dc2dd4d6aa, regionState=CLOSED 2023-09-12 21:01:16,727 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694552476726"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694552476726"}]},"ts":"1694552476726"} 2023-09-12 21:01:16,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-09-12 21:01:16,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure b69ea3f104679d1488f58d79f7a86a67, server=jenkins-hbase9.apache.org,45939,1694552367290 in 172 msec 2023-09-12 21:01:16,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-09-12 21:01:16,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 741b8581a5ae56a69b3f59dc2dd4d6aa, server=jenkins-hbase9.apache.org,42813,1694552367323 in 172 msec 2023-09-12 21:01:16,732 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b69ea3f104679d1488f58d79f7a86a67, UNASSIGN in 178 msec 2023-09-12 21:01:16,733 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-12 21:01:16,733 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=741b8581a5ae56a69b3f59dc2dd4d6aa, UNASSIGN in 178 msec 2023-09-12 21:01:16,734 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694552476734"}]},"ts":"1694552476734"} 2023-09-12 21:01:16,735 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-12 21:01:16,736 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-12 21:01:16,737 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 190 msec 2023-09-12 21:01:16,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-12 21:01:16,852 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-12 21:01:16,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,855 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,855 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,856 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45939] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,859 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa 2023-09-12 21:01:16,859 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67 2023-09-12 21:01:16,860 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,860 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,860 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,860 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,861 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/recovered.edits] 2023-09-12 21:01:16,861 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/cf, FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/recovered.edits] 2023-09-12 21:01:16,862 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-12 21:01:16,862 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-12 21:01:16,862 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-12 21:01:16,863 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,863 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:01:16,863 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,863 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,863 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:01:16,863 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-09-12 21:01:16,863 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:01:16,863 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-12 21:01:16,863 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 21:01:16,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-12 21:01:16,865 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/cf/9b7c85f72c5446a2b26486caa94a5406 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/cf/9b7c85f72c5446a2b26486caa94a5406 2023-09-12 21:01:16,865 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/cf/430ca839110f497c99c2c667d424110e to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/cf/430ca839110f497c99c2c667d424110e 2023-09-12 21:01:16,868 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/recovered.edits/9.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa/recovered.edits/9.seqid 2023-09-12 21:01:16,868 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/recovered.edits/9.seqid to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67/recovered.edits/9.seqid 2023-09-12 21:01:16,868 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/741b8581a5ae56a69b3f59dc2dd4d6aa 2023-09-12 21:01:16,869 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b69ea3f104679d1488f58d79f7a86a67 2023-09-12 21:01:16,869 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-12 21:01:16,869 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-12 21:01:16,870 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-12 21:01:16,873 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309121a8a06aecb3b4baa9b2f4d1d1799e5de to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309121a8a06aecb3b4baa9b2f4d1d1799e5de 2023-09-12 21:01:16,874 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230912e387c8da8e9e48f68de63218c3478f13 to hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230912e387c8da8e9e48f68de63218c3478f13 2023-09-12 21:01:16,874 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-12 21:01:16,876 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,877 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-12 21:01:16,879 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-12 21:01:16,880 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,880 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-12 21:01:16,880 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694552476880"}]},"ts":"9223372036854775807"} 2023-09-12 21:01:16,880 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694552476880"}]},"ts":"9223372036854775807"} 2023-09-12 21:01:16,882 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-12 21:01:16,882 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 741b8581a5ae56a69b3f59dc2dd4d6aa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694552461961.741b8581a5ae56a69b3f59dc2dd4d6aa.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b69ea3f104679d1488f58d79f7a86a67, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694552461961.b69ea3f104679d1488f58d79f7a86a67.', STARTKEY => '1', ENDKEY => ''}] 2023-09-12 21:01:16,882 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-12 21:01:16,882 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694552476882"}]},"ts":"9223372036854775807"} 2023-09-12 21:01:16,883 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-12 21:01:16,885 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,886 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 32 msec 2023-09-12 21:01:16,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-12 21:01:16,965 INFO [Listener at jenkins-hbase9.apache.org/32837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-12 21:01:16,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-12 21:01:16,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-12 21:01:16,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38453] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 21:01:16,997 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 764) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:37440 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:53250 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1717814969_1 at /127.0.0.1:57132 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (640167340) connection to jenkins-hbase9.apache.org/172.31.2.10:35275 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-480281790_17 at /127.0.0.1:57162 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5214 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x69eed78f-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 944), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=265 (was 302), ProcessCount=168 (was 168), AvailableMemoryMB=5635 (was 5736) 2023-09-12 21:01:16,997 WARN [Listener at jenkins-hbase9.apache.org/32837] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-12 21:01:16,997 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-12 21:01:17,008 INFO [Listener at jenkins-hbase9.apache.org/32837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-12 21:01:17,119 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1694552373675_0007_01_000001 is : 143 2023-09-12 21:01:22,288 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 21:01:31,136 INFO [Listener at jenkins-hbase9.apache.org/32837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-12 21:01:45,255 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-12 21:01:45,255 INFO [Listener at jenkins-hbase9.apache.org/32837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-12 21:01:45,364 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-12 21:01:45,372 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-12 21:01:45,373 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-12 21:01:45,384 INFO [Listener at jenkins-hbase9.apache.org/32837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-12 21:01:45,487 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-12 21:01:45,487 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-12 21:01:45,487 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-12 21:01:45,487 INFO [Listener at jenkins-hbase9.apache.org/32837] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-12 21:01:45,488 DEBUG [Listener at jenkins-hbase9.apache.org/32837] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d2f3867 to 127.0.0.1:58083 2023-09-12 21:01:45,488 DEBUG [Listener at jenkins-hbase9.apache.org/32837] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:01:45,488 DEBUG [Listener at jenkins-hbase9.apache.org/32837] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-12 21:01:45,488 DEBUG [Listener at jenkins-hbase9.apache.org/32837] util.JVMClusterUtil(257): Found active master hash=1283977382, stopped=false 2023-09-12 21:01:45,488 DEBUG [Listener at jenkins-hbase9.apache.org/32837] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:45,488 DEBUG [Listener at jenkins-hbase9.apache.org/32837] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-12 21:01:45,488 INFO [Listener at jenkins-hbase9.apache.org/32837] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,38453,1694552366017 2023-09-12 21:01:45,490 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-12 21:01:45,490 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-12 21:01:45,490 INFO [Listener at jenkins-hbase9.apache.org/32837] procedure2.ProcedureExecutor(628): Stopping 2023-09-12 21:01:45,490 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-12 21:01:45,490 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-12 21:01:45,490 DEBUG [Listener at jenkins-hbase9.apache.org/32837] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03a086d1 to 127.0.0.1:58083 2023-09-12 21:01:45,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 21:01:45,490 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 21:01:45,490 DEBUG [Listener at jenkins-hbase9.apache.org/32837] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:01:45,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 21:01:45,490 INFO [Listener at jenkins-hbase9.apache.org/32837] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,34031,1694552367245' ***** 2023-09-12 21:01:45,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 21:01:45,491 DEBUG [Listener at jenkins-hbase9.apache.org/32837] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:45,491 INFO [Listener at jenkins-hbase9.apache.org/32837] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-12 21:01:45,491 INFO [Listener at jenkins-hbase9.apache.org/32837] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,45939,1694552367290' ***** 2023-09-12 21:01:45,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 21:01:45,491 DEBUG [Listener at jenkins-hbase9.apache.org/32837] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:45,491 INFO [RS:0;jenkins-hbase9:34031] regionserver.HeapMemoryManager(220): Stopping 2023-09-12 21:01:45,491 INFO [Listener at jenkins-hbase9.apache.org/32837] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-12 21:01:45,491 INFO [Listener at jenkins-hbase9.apache.org/32837] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,42813,1694552367323' ***** 2023-09-12 21:01:45,491 INFO [RS:0;jenkins-hbase9:34031] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-12 21:01:45,491 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-12 21:01:45,491 INFO [RS:0;jenkins-hbase9:34031] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-12 21:01:45,491 INFO [RS:1;jenkins-hbase9:45939] regionserver.HeapMemoryManager(220): Stopping 2023-09-12 21:01:45,491 DEBUG [Listener at jenkins-hbase9.apache.org/32837] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:45,491 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-12 21:01:45,492 INFO [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(3305): Received CLOSE for ce2b7366128e33822ca30f39c1a504ce 2023-09-12 21:01:45,492 INFO [Listener at jenkins-hbase9.apache.org/32837] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-12 21:01:45,491 INFO [RS:1;jenkins-hbase9:45939] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-12 21:01:45,492 INFO [RS:1;jenkins-hbase9:45939] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-12 21:01:45,492 INFO [RS:2;jenkins-hbase9:42813] regionserver.HeapMemoryManager(220): Stopping 2023-09-12 21:01:45,492 INFO [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:45,492 INFO [RS:2;jenkins-hbase9:42813] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-12 21:01:45,492 DEBUG [RS:0;jenkins-hbase9:34031] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66a04709 to 127.0.0.1:58083 2023-09-12 21:01:45,492 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-12 21:01:45,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ce2b7366128e33822ca30f39c1a504ce, disabling compactions & flushes 2023-09-12 21:01:45,492 INFO [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(3305): Received CLOSE for b9e82d56b3db915c6632d50a60750688 2023-09-12 21:01:45,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. 2023-09-12 21:01:45,493 INFO [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:45,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. 2023-09-12 21:01:45,493 DEBUG [RS:1;jenkins-hbase9:45939] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a7d8803 to 127.0.0.1:58083 2023-09-12 21:01:45,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing b9e82d56b3db915c6632d50a60750688, disabling compactions & flushes 2023-09-12 21:01:45,492 DEBUG [RS:0;jenkins-hbase9:34031] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:01:45,492 INFO [RS:2;jenkins-hbase9:42813] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-12 21:01:45,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. 2023-09-12 21:01:45,493 DEBUG [RS:1;jenkins-hbase9:45939] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:01:45,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. after waiting 0 ms 2023-09-12 21:01:45,495 INFO [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-12 21:01:45,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. 2023-09-12 21:01:45,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. 2023-09-12 21:01:45,495 INFO [RS:2;jenkins-hbase9:42813] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:45,495 INFO [RS:0;jenkins-hbase9:34031] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-12 21:01:45,496 DEBUG [RS:2;jenkins-hbase9:42813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d87e5ec to 127.0.0.1:58083 2023-09-12 21:01:45,496 INFO [RS:0;jenkins-hbase9:34031] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-12 21:01:45,496 DEBUG [RS:2;jenkins-hbase9:42813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:01:45,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. after waiting 0 ms 2023-09-12 21:01:45,496 INFO [RS:2;jenkins-hbase9:42813] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,42813,1694552367323; all regions closed. 2023-09-12 21:01:45,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing ce2b7366128e33822ca30f39c1a504ce 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-12 21:01:45,496 DEBUG [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(1478): Online Regions={b9e82d56b3db915c6632d50a60750688=hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688.} 2023-09-12 21:01:45,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. 2023-09-12 21:01:45,496 INFO [RS:0;jenkins-hbase9:34031] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-12 21:01:45,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing b9e82d56b3db915c6632d50a60750688 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-12 21:01:45,497 INFO [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-12 21:01:45,497 INFO [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-12 21:01:45,497 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-12 21:01:45,497 DEBUG [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, ce2b7366128e33822ca30f39c1a504ce=hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce.} 2023-09-12 21:01:45,498 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-12 21:01:45,498 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-12 21:01:45,498 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-12 21:01:45,498 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-12 21:01:45,498 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-12 21:01:45,498 DEBUG [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(1504): Waiting on b9e82d56b3db915c6632d50a60750688 2023-09-12 21:01:45,498 DEBUG [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(1504): Waiting on 1588230740, ce2b7366128e33822ca30f39c1a504ce 2023-09-12 21:01:45,539 DEBUG [RS:2;jenkins-hbase9:42813] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/oldWALs 2023-09-12 21:01:45,539 INFO [RS:2;jenkins-hbase9:42813] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C42813%2C1694552367323:(num 1694552368841) 2023-09-12 21:01:45,539 DEBUG [RS:2;jenkins-hbase9:42813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:01:45,539 INFO [RS:2;jenkins-hbase9:42813] regionserver.LeaseManager(133): Closed leases 2023-09-12 21:01:45,540 INFO [RS:2;jenkins-hbase9:42813] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-12 21:01:45,541 INFO [RS:2;jenkins-hbase9:42813] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-12 21:01:45,541 INFO [RS:2;jenkins-hbase9:42813] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-12 21:01:45,541 INFO [RS:2;jenkins-hbase9:42813] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-12 21:01:45,541 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-12 21:01:45,542 INFO [RS:2;jenkins-hbase9:42813] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:42813 2023-09-12 21:01:45,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/acl/b9e82d56b3db915c6632d50a60750688/.tmp/l/2b2b8cdeeef445a38f311d1f7472a975 2023-09-12 21:01:45,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/namespace/ce2b7366128e33822ca30f39c1a504ce/.tmp/info/7e87889f8f574ee886d305dbbc1d8ae3 2023-09-12 21:01:45,550 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:45,551 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:45,551 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 21:01:45,551 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 21:01:45,551 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,42813,1694552367323 2023-09-12 21:01:45,551 ERROR [Listener at localhost/37459-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6868fc9c rejected from java.util.concurrent.ThreadPoolExecutor@6c576549[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 109] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-09-12 21:01:45,551 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 21:01:45,551 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 21:01:45,552 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,42813,1694552367323] 2023-09-12 21:01:45,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/namespace/ce2b7366128e33822ca30f39c1a504ce/.tmp/info/7e87889f8f574ee886d305dbbc1d8ae3 as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/namespace/ce2b7366128e33822ca30f39c1a504ce/info/7e87889f8f574ee886d305dbbc1d8ae3 2023-09-12 21:01:45,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/namespace/ce2b7366128e33822ca30f39c1a504ce/info/7e87889f8f574ee886d305dbbc1d8ae3, entries=2, sequenceid=6, filesize=4.8 K 2023-09-12 21:01:45,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ce2b7366128e33822ca30f39c1a504ce in 63ms, sequenceid=6, compaction requested=false 2023-09-12 21:01:45,560 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/.tmp/info/07b76cc050c84427b006a7c4b5a3e5f3 2023-09-12 21:01:45,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b2b8cdeeef445a38f311d1f7472a975 2023-09-12 21:01:45,562 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,42813,1694552367323; numProcessing=1 2023-09-12 21:01:45,563 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,42813,1694552367323 already deleted, retry=false 2023-09-12 21:01:45,563 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,42813,1694552367323 expired; onlineServers=2 2023-09-12 21:01:45,565 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-12 21:01:45,565 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-12 21:01:45,565 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-12 21:01:45,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/acl/b9e82d56b3db915c6632d50a60750688/.tmp/l/2b2b8cdeeef445a38f311d1f7472a975 as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/acl/b9e82d56b3db915c6632d50a60750688/l/2b2b8cdeeef445a38f311d1f7472a975 2023-09-12 21:01:45,570 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07b76cc050c84427b006a7c4b5a3e5f3 2023-09-12 21:01:45,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/namespace/ce2b7366128e33822ca30f39c1a504ce/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 21:01:45,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:45,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. 2023-09-12 21:01:45,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ce2b7366128e33822ca30f39c1a504ce: 2023-09-12 21:01:45,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1694552369370.ce2b7366128e33822ca30f39c1a504ce. 2023-09-12 21:01:45,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b2b8cdeeef445a38f311d1f7472a975 2023-09-12 21:01:45,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/acl/b9e82d56b3db915c6632d50a60750688/l/2b2b8cdeeef445a38f311d1f7472a975, entries=7, sequenceid=18, filesize=5.2 K 2023-09-12 21:01:45,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for b9e82d56b3db915c6632d50a60750688 in 77ms, sequenceid=18, compaction requested=false 2023-09-12 21:01:45,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/acl/b9e82d56b3db915c6632d50a60750688/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-12 21:01:45,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:45,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. 2023-09-12 21:01:45,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for b9e82d56b3db915c6632d50a60750688: 2023-09-12 21:01:45,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1694552370107.b9e82d56b3db915c6632d50a60750688. 2023-09-12 21:01:45,588 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/.tmp/rep_barrier/d3346878035f4a9099cdfd5bd0cb390f 2023-09-12 21:01:45,593 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3346878035f4a9099cdfd5bd0cb390f 2023-09-12 21:01:45,607 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/.tmp/table/0c4c392bd11f447c878d6410b611e0a9 2023-09-12 21:01:45,611 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c4c392bd11f447c878d6410b611e0a9 2023-09-12 21:01:45,612 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/.tmp/info/07b76cc050c84427b006a7c4b5a3e5f3 as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/info/07b76cc050c84427b006a7c4b5a3e5f3 2023-09-12 21:01:45,616 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07b76cc050c84427b006a7c4b5a3e5f3 2023-09-12 21:01:45,616 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/info/07b76cc050c84427b006a7c4b5a3e5f3, entries=48, sequenceid=131, filesize=10.3 K 2023-09-12 21:01:45,617 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/.tmp/rep_barrier/d3346878035f4a9099cdfd5bd0cb390f as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/rep_barrier/d3346878035f4a9099cdfd5bd0cb390f 2023-09-12 21:01:45,621 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3346878035f4a9099cdfd5bd0cb390f 2023-09-12 21:01:45,621 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/rep_barrier/d3346878035f4a9099cdfd5bd0cb390f, entries=13, sequenceid=131, filesize=6.4 K 2023-09-12 21:01:45,622 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/.tmp/table/0c4c392bd11f447c878d6410b611e0a9 as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/table/0c4c392bd11f447c878d6410b611e0a9 2023-09-12 21:01:45,626 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c4c392bd11f447c878d6410b611e0a9 2023-09-12 21:01:45,627 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/table/0c4c392bd11f447c878d6410b611e0a9, entries=24, sequenceid=131, filesize=6.9 K 2023-09-12 21:01:45,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 129ms, sequenceid=131, compaction requested=false 2023-09-12 21:01:45,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-12 21:01:45,639 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:45,639 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-12 21:01:45,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-12 21:01:45,640 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-12 21:01:45,640 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-12 21:01:45,653 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 21:01:45,653 INFO [RS:2;jenkins-hbase9:42813] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,42813,1694552367323; zookeeper connection closed. 2023-09-12 21:01:45,653 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:42813-0x100a1e28c4e0003, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 21:01:45,653 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@30b39133] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@30b39133 2023-09-12 21:01:45,683 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-12 21:01:45,684 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-12 21:01:45,684 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-12 21:01:45,684 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-12 21:01:45,698 INFO [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,45939,1694552367290; all regions closed. 2023-09-12 21:01:45,698 INFO [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,34031,1694552367245; all regions closed. 2023-09-12 21:01:45,706 DEBUG [RS:0;jenkins-hbase9:34031] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/oldWALs 2023-09-12 21:01:45,706 INFO [RS:0;jenkins-hbase9:34031] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C34031%2C1694552367245.meta:.meta(num 1694552369097) 2023-09-12 21:01:45,706 DEBUG [RS:1;jenkins-hbase9:45939] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/oldWALs 2023-09-12 21:01:45,706 INFO [RS:1;jenkins-hbase9:45939] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45939%2C1694552367290:(num 1694552368841) 2023-09-12 21:01:45,707 DEBUG [RS:1;jenkins-hbase9:45939] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:01:45,707 INFO [RS:1;jenkins-hbase9:45939] regionserver.LeaseManager(133): Closed leases 2023-09-12 21:01:45,707 INFO [RS:1;jenkins-hbase9:45939] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-12 21:01:45,707 INFO [RS:1;jenkins-hbase9:45939] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-12 21:01:45,707 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-12 21:01:45,708 INFO [RS:1;jenkins-hbase9:45939] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-12 21:01:45,708 INFO [RS:1;jenkins-hbase9:45939] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-12 21:01:45,709 INFO [RS:1;jenkins-hbase9:45939] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45939 2023-09-12 21:01:45,712 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:45,712 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45939,1694552367290 2023-09-12 21:01:45,712 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 21:01:45,712 DEBUG [RS:0;jenkins-hbase9:34031] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/oldWALs 2023-09-12 21:01:45,712 INFO [RS:0;jenkins-hbase9:34031] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C34031%2C1694552367245:(num 1694552368842) 2023-09-12 21:01:45,712 DEBUG [RS:0;jenkins-hbase9:34031] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:01:45,712 INFO [RS:0;jenkins-hbase9:34031] regionserver.LeaseManager(133): Closed leases 2023-09-12 21:01:45,713 INFO [RS:0;jenkins-hbase9:34031] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-12 21:01:45,713 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-12 21:01:45,714 INFO [RS:0;jenkins-hbase9:34031] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:34031 2023-09-12 21:01:45,714 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,45939,1694552367290] 2023-09-12 21:01:45,714 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,45939,1694552367290; numProcessing=2 2023-09-12 21:01:45,715 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,34031,1694552367245 2023-09-12 21:01:45,715 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 21:01:45,716 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,45939,1694552367290 already deleted, retry=false 2023-09-12 21:01:45,716 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,45939,1694552367290 expired; onlineServers=1 2023-09-12 21:01:45,717 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,34031,1694552367245] 2023-09-12 21:01:45,717 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,34031,1694552367245; numProcessing=3 2023-09-12 21:01:45,719 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,34031,1694552367245 already deleted, retry=false 2023-09-12 21:01:45,719 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,34031,1694552367245 expired; onlineServers=0 2023-09-12 21:01:45,720 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,38453,1694552366017' ***** 2023-09-12 21:01:45,720 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-12 21:01:45,720 DEBUG [M:0;jenkins-hbase9:38453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dbafa9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-12 21:01:45,720 INFO [M:0;jenkins-hbase9:38453] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,38453,1694552366017 2023-09-12 21:01:45,720 INFO [M:0;jenkins-hbase9:38453] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,38453,1694552366017; all regions closed. 2023-09-12 21:01:45,720 DEBUG [M:0;jenkins-hbase9:38453] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 21:01:45,720 DEBUG [M:0;jenkins-hbase9:38453] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-12 21:01:45,720 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-12 21:01:45,720 DEBUG [M:0;jenkins-hbase9:38453] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-12 21:01:45,720 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1694552368515] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1694552368515,5,FailOnTimeoutGroup] 2023-09-12 21:01:45,720 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1694552368515] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1694552368515,5,FailOnTimeoutGroup] 2023-09-12 21:01:45,720 INFO [M:0;jenkins-hbase9:38453] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-12 21:01:45,720 INFO [M:0;jenkins-hbase9:38453] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-12 21:01:45,720 INFO [M:0;jenkins-hbase9:38453] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-09-12 21:01:45,721 DEBUG [M:0;jenkins-hbase9:38453] master.HMaster(1512): Stopping service threads 2023-09-12 21:01:45,721 INFO [M:0;jenkins-hbase9:38453] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-12 21:01:45,721 ERROR [M:0;jenkins-hbase9:38453] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-12 21:01:45,721 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-12 21:01:45,721 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 21:01:45,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-12 21:01:45,721 INFO [M:0;jenkins-hbase9:38453] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-12 21:01:45,722 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-12 21:01:45,722 DEBUG [M:0;jenkins-hbase9:38453] zookeeper.ZKUtil(398): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-12 21:01:45,722 WARN [M:0;jenkins-hbase9:38453] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-12 21:01:45,722 INFO [M:0;jenkins-hbase9:38453] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-12 21:01:45,722 INFO [M:0;jenkins-hbase9:38453] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-12 21:01:45,723 DEBUG [M:0;jenkins-hbase9:38453] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-12 21:01:45,723 INFO [M:0;jenkins-hbase9:38453] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 21:01:45,723 DEBUG [M:0;jenkins-hbase9:38453] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 21:01:45,723 DEBUG [M:0;jenkins-hbase9:38453] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-12 21:01:45,723 DEBUG [M:0;jenkins-hbase9:38453] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 21:01:45,723 INFO [M:0;jenkins-hbase9:38453] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.91 KB heapSize=452.19 KB 2023-09-12 21:01:45,741 INFO [M:0;jenkins-hbase9:38453] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.91 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b90c2fc136c848609d7152de5a3f2bf9 2023-09-12 21:01:45,745 INFO [M:0;jenkins-hbase9:38453] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b90c2fc136c848609d7152de5a3f2bf9 2023-09-12 21:01:45,746 DEBUG [M:0;jenkins-hbase9:38453] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b90c2fc136c848609d7152de5a3f2bf9 as hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b90c2fc136c848609d7152de5a3f2bf9 2023-09-12 21:01:45,750 INFO [M:0;jenkins-hbase9:38453] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b90c2fc136c848609d7152de5a3f2bf9 2023-09-12 21:01:45,751 INFO [M:0;jenkins-hbase9:38453] regionserver.HStore(1080): Added hdfs://localhost:38861/user/jenkins/test-data/d3a3a2c7-3954-f394-0388-c88c39c21944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b90c2fc136c848609d7152de5a3f2bf9, entries=119, sequenceid=899, filesize=28.7 K 2023-09-12 21:01:45,751 INFO [M:0;jenkins-hbase9:38453] regionserver.HRegion(2948): Finished flush of dataSize ~375.91 KB/384935, heapSize ~452.17 KB/463024, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=899, compaction requested=false 2023-09-12 21:01:45,753 INFO [M:0;jenkins-hbase9:38453] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 21:01:45,753 DEBUG [M:0;jenkins-hbase9:38453] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-12 21:01:45,757 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-12 21:01:45,757 INFO [M:0;jenkins-hbase9:38453] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-12 21:01:45,758 INFO [M:0;jenkins-hbase9:38453] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:38453 2023-09-12 21:01:45,760 DEBUG [M:0;jenkins-hbase9:38453] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,38453,1694552366017 already deleted, retry=false 2023-09-12 21:01:45,814 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 21:01:45,814 INFO [RS:1;jenkins-hbase9:45939] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,45939,1694552367290; zookeeper connection closed. 2023-09-12 21:01:45,814 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:45939-0x100a1e28c4e0002, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 21:01:45,815 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@744f85d2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@744f85d2 2023-09-12 21:01:45,915 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 21:01:45,915 INFO [M:0;jenkins-hbase9:38453] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,38453,1694552366017; zookeeper connection closed. 2023-09-12 21:01:45,915 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): master:38453-0x100a1e28c4e0000, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 21:01:46,015 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 21:01:46,015 DEBUG [Listener at localhost/37459-EventThread] zookeeper.ZKWatcher(600): regionserver:34031-0x100a1e28c4e0001, quorum=127.0.0.1:58083, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 21:01:46,015 INFO [RS:0;jenkins-hbase9:34031] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,34031,1694552367245; zookeeper connection closed. 2023-09-12 21:01:46,015 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@59c5cec6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@59c5cec6 2023-09-12 21:01:46,015 INFO [Listener at jenkins-hbase9.apache.org/32837] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-12 21:01:46,016 WARN [Listener at jenkins-hbase9.apache.org/32837] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-12 21:01:46,018 INFO [Listener at jenkins-hbase9.apache.org/32837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-12 21:01:46,121 WARN [BP-735326920-172.31.2.10-1694552362399 heartbeating to localhost/127.0.0.1:38861] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-12 21:01:46,121 WARN [BP-735326920-172.31.2.10-1694552362399 heartbeating to localhost/127.0.0.1:38861] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-735326920-172.31.2.10-1694552362399 (Datanode Uuid d04a1494-5e5e-4e47-8587-b643a1ed77d2) service to localhost/127.0.0.1:38861 2023-09-12 21:01:46,123 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/dfs/data/data5/current/BP-735326920-172.31.2.10-1694552362399] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-12 21:01:46,123 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/dfs/data/data6/current/BP-735326920-172.31.2.10-1694552362399] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-12 21:01:46,124 WARN [Listener at jenkins-hbase9.apache.org/32837] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-12 21:01:46,126 INFO [Listener at jenkins-hbase9.apache.org/32837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-12 21:01:46,190 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:46,190 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-12 21:01:46,190 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:46,190 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-12 21:01:46,190 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 21:01:46,228 WARN [BP-735326920-172.31.2.10-1694552362399 heartbeating to localhost/127.0.0.1:38861] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-12 21:01:46,228 WARN [BP-735326920-172.31.2.10-1694552362399 heartbeating to localhost/127.0.0.1:38861] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-735326920-172.31.2.10-1694552362399 (Datanode Uuid 73c19682-0241-4472-9972-b38ede35e2ea) service to localhost/127.0.0.1:38861 2023-09-12 21:01:46,228 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/dfs/data/data3/current/BP-735326920-172.31.2.10-1694552362399] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-12 21:01:46,229 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/dfs/data/data4/current/BP-735326920-172.31.2.10-1694552362399] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-12 21:01:46,229 WARN [Listener at jenkins-hbase9.apache.org/32837] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-12 21:01:46,231 INFO [Listener at jenkins-hbase9.apache.org/32837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-12 21:01:46,333 WARN [BP-735326920-172.31.2.10-1694552362399 heartbeating to localhost/127.0.0.1:38861] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-12 21:01:46,333 WARN [BP-735326920-172.31.2.10-1694552362399 heartbeating to localhost/127.0.0.1:38861] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-735326920-172.31.2.10-1694552362399 (Datanode Uuid 8a5c3bbd-7ec2-4c29-8218-0466ee1095f6) service to localhost/127.0.0.1:38861 2023-09-12 21:01:46,334 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/dfs/data/data1/current/BP-735326920-172.31.2.10-1694552362399] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-12 21:01:46,334 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/191c4701-44f7-2767-4240-2402a84cdacd/cluster_69155d1a-4760-96d6-181b-d8f665a14059/dfs/data/data2/current/BP-735326920-172.31.2.10-1694552362399] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-12 21:01:46,357 INFO [Listener at jenkins-hbase9.apache.org/32837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-12 21:01:46,481 INFO [Listener at jenkins-hbase9.apache.org/32837] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-12 21:01:46,562 INFO [Listener at jenkins-hbase9.apache.org/32837] hbase.HBaseTestingUtility(1293): Minicluster is down