2023-07-19 10:10:12,752 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-19 10:10:13,012 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c 2023-07-19 10:10:13,012 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-19 10:10:13,056 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-19 10:10:13,339 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-19 10:10:13,340 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32, deleteOnExit=true 2023-07-19 10:10:13,340 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-19 10:10:13,340 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/test.cache.data in system properties and HBase conf 2023-07-19 10:10:13,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 10:10:13,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop.log.dir in system properties and HBase conf 2023-07-19 10:10:13,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 10:10:13,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 10:10:13,342 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 10:10:13,804 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-19 10:10:13,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 10:10:13,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 10:10:13,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 10:10:13,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 10:10:13,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 10:10:13,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 10:10:13,815 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 10:10:13,815 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 10:10:13,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 10:10:13,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/nfs.dump.dir in system properties and HBase conf 2023-07-19 10:10:13,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/java.io.tmpdir in system properties and HBase conf 2023-07-19 10:10:13,817 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 10:10:13,817 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 10:10:13,818 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-19 10:10:14,490 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 10:10:14,495 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 10:10:14,857 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-19 10:10:15,077 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-19 10:10:15,097 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:15,140 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:15,187 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/java.io.tmpdir/Jetty_localhost_41359_hdfs____resnxg/webapp 2023-07-19 10:10:15,365 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41359 2023-07-19 10:10:15,376 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 10:10:15,376 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 10:10:15,949 WARN [Listener at localhost/35157] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 10:10:16,058 WARN [Listener at localhost/35157] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 10:10:16,188 WARN [Listener at localhost/35157] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:16,197 INFO [Listener at localhost/35157] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:16,206 INFO [Listener at localhost/35157] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/java.io.tmpdir/Jetty_localhost_45963_datanode____.bh0c1w/webapp 2023-07-19 10:10:16,325 INFO [Listener at localhost/35157] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45963 2023-07-19 10:10:16,837 WARN [Listener at localhost/40069] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 10:10:16,882 WARN [Listener at localhost/40069] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 10:10:16,888 WARN [Listener at localhost/40069] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:16,892 INFO [Listener at localhost/40069] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:16,904 INFO [Listener at localhost/40069] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/java.io.tmpdir/Jetty_localhost_36309_datanode____.srxvts/webapp 2023-07-19 10:10:17,031 INFO [Listener at localhost/40069] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36309 2023-07-19 10:10:17,062 WARN [Listener at localhost/43283] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 10:10:17,134 WARN [Listener at localhost/43283] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 10:10:17,138 WARN [Listener at localhost/43283] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:17,140 INFO [Listener at localhost/43283] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:17,153 INFO [Listener at localhost/43283] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/java.io.tmpdir/Jetty_localhost_41947_datanode____jm2wxy/webapp 2023-07-19 10:10:17,332 INFO [Listener at localhost/43283] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41947 2023-07-19 10:10:17,374 WARN [Listener at localhost/44891] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 10:10:17,747 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe2bbcdd7d3835a6f: Processing first storage report for DS-aa8aa534-c721-4e1a-9c65-f2d9aa5841ab from datanode 904c2d21-7cd4-4753-9903-19d6b751740f 2023-07-19 10:10:17,749 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe2bbcdd7d3835a6f: from storage DS-aa8aa534-c721-4e1a-9c65-f2d9aa5841ab node DatanodeRegistration(127.0.0.1:40889, datanodeUuid=904c2d21-7cd4-4753-9903-19d6b751740f, infoPort=46703, infoSecurePort=0, ipcPort=44891, storageInfo=lv=-57;cid=testClusterID;nsid=856908466;c=1689761414590), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-19 10:10:17,749 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x15a6cab9739218f4: Processing first storage report for DS-a91397ee-e121-4ef3-9762-cb7285331846 from datanode bb3c6a58-8e51-4733-9e9a-48cbe2a61752 2023-07-19 10:10:17,750 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x15a6cab9739218f4: from storage DS-a91397ee-e121-4ef3-9762-cb7285331846 node DatanodeRegistration(127.0.0.1:35901, datanodeUuid=bb3c6a58-8e51-4733-9e9a-48cbe2a61752, infoPort=35589, infoSecurePort=0, ipcPort=43283, storageInfo=lv=-57;cid=testClusterID;nsid=856908466;c=1689761414590), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 10:10:17,750 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe2bbcdd7d3835a6f: Processing first storage report for DS-eb671aa6-6c6d-486a-b62b-8642c88f80ef from datanode 904c2d21-7cd4-4753-9903-19d6b751740f 2023-07-19 10:10:17,750 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe2bbcdd7d3835a6f: from storage DS-eb671aa6-6c6d-486a-b62b-8642c88f80ef node DatanodeRegistration(127.0.0.1:40889, datanodeUuid=904c2d21-7cd4-4753-9903-19d6b751740f, infoPort=46703, infoSecurePort=0, ipcPort=44891, storageInfo=lv=-57;cid=testClusterID;nsid=856908466;c=1689761414590), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 10:10:17,750 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x15a6cab9739218f4: Processing first storage report for DS-3250e2fd-3a86-4bb9-a757-b1b251a43bc6 from datanode bb3c6a58-8e51-4733-9e9a-48cbe2a61752 2023-07-19 10:10:17,750 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x15a6cab9739218f4: from storage DS-3250e2fd-3a86-4bb9-a757-b1b251a43bc6 node DatanodeRegistration(127.0.0.1:35901, datanodeUuid=bb3c6a58-8e51-4733-9e9a-48cbe2a61752, infoPort=35589, infoSecurePort=0, ipcPort=43283, storageInfo=lv=-57;cid=testClusterID;nsid=856908466;c=1689761414590), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 10:10:17,750 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x183560218a054bc3: Processing first storage report for DS-f1549d69-1a3c-4ed7-95ff-19a04212de66 from datanode 5d09ee0b-5e3a-4f56-8b72-b333d5ead0d5 2023-07-19 10:10:17,751 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x183560218a054bc3: from storage DS-f1549d69-1a3c-4ed7-95ff-19a04212de66 node DatanodeRegistration(127.0.0.1:37877, datanodeUuid=5d09ee0b-5e3a-4f56-8b72-b333d5ead0d5, infoPort=39379, infoSecurePort=0, ipcPort=40069, storageInfo=lv=-57;cid=testClusterID;nsid=856908466;c=1689761414590), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 10:10:17,751 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x183560218a054bc3: Processing first storage report for DS-31a686ba-9b68-4b36-893b-a06cb0405b40 from datanode 5d09ee0b-5e3a-4f56-8b72-b333d5ead0d5 2023-07-19 10:10:17,751 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x183560218a054bc3: from storage DS-31a686ba-9b68-4b36-893b-a06cb0405b40 node DatanodeRegistration(127.0.0.1:37877, datanodeUuid=5d09ee0b-5e3a-4f56-8b72-b333d5ead0d5, infoPort=39379, infoSecurePort=0, ipcPort=40069, storageInfo=lv=-57;cid=testClusterID;nsid=856908466;c=1689761414590), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 10:10:17,991 DEBUG [Listener at localhost/44891] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c 2023-07-19 10:10:18,115 INFO [Listener at localhost/44891] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/zookeeper_0, clientPort=56876, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-19 10:10:18,141 INFO [Listener at localhost/44891] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56876 2023-07-19 10:10:18,152 INFO [Listener at localhost/44891] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:18,154 INFO [Listener at localhost/44891] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:18,864 INFO [Listener at localhost/44891] util.FSUtils(471): Created version file at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc with version=8 2023-07-19 10:10:18,864 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/hbase-staging 2023-07-19 10:10:19,263 INFO [Listener at localhost/44891] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-19 10:10:19,947 INFO [Listener at localhost/44891] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 10:10:19,982 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:19,983 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:19,983 INFO [Listener at localhost/44891] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 10:10:19,983 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:19,984 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 10:10:20,154 INFO [Listener at localhost/44891] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 10:10:20,267 DEBUG [Listener at localhost/44891] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 10:10:20,370 INFO [Listener at localhost/44891] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40385 2023-07-19 10:10:20,384 INFO [Listener at localhost/44891] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,387 INFO [Listener at localhost/44891] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,414 INFO [Listener at localhost/44891] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40385 connecting to ZooKeeper ensemble=127.0.0.1:56876 2023-07-19 10:10:20,510 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:403850x0, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 10:10:20,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40385-0x1017d0f8e620000 connected 2023-07-19 10:10:20,576 DEBUG [Listener at localhost/44891] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 10:10:20,579 DEBUG [Listener at localhost/44891] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:10:20,599 DEBUG [Listener at localhost/44891] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 10:10:20,618 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40385 2023-07-19 10:10:20,622 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40385 2023-07-19 10:10:20,626 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40385 2023-07-19 10:10:20,627 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40385 2023-07-19 10:10:20,628 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40385 2023-07-19 10:10:20,636 INFO [Listener at localhost/44891] master.HMaster(444): hbase.rootdir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc, hbase.cluster.distributed=false 2023-07-19 10:10:20,713 INFO [Listener at localhost/44891] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 10:10:20,714 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,714 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,714 INFO [Listener at localhost/44891] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 10:10:20,714 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,715 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 10:10:20,719 INFO [Listener at localhost/44891] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 10:10:20,723 INFO [Listener at localhost/44891] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35123 2023-07-19 10:10:20,726 INFO [Listener at localhost/44891] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 10:10:20,734 DEBUG [Listener at localhost/44891] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 10:10:20,735 INFO [Listener at localhost/44891] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,737 INFO [Listener at localhost/44891] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,740 INFO [Listener at localhost/44891] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35123 connecting to ZooKeeper ensemble=127.0.0.1:56876 2023-07-19 10:10:20,748 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:351230x0, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 10:10:20,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35123-0x1017d0f8e620001 connected 2023-07-19 10:10:20,749 DEBUG [Listener at localhost/44891] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 10:10:20,750 DEBUG [Listener at localhost/44891] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:10:20,751 DEBUG [Listener at localhost/44891] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 10:10:20,755 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35123 2023-07-19 10:10:20,755 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35123 2023-07-19 10:10:20,755 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35123 2023-07-19 10:10:20,756 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35123 2023-07-19 10:10:20,757 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35123 2023-07-19 10:10:20,775 INFO [Listener at localhost/44891] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 10:10:20,776 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,776 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,776 INFO [Listener at localhost/44891] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 10:10:20,776 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,777 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 10:10:20,777 INFO [Listener at localhost/44891] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 10:10:20,778 INFO [Listener at localhost/44891] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44313 2023-07-19 10:10:20,779 INFO [Listener at localhost/44891] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 10:10:20,781 DEBUG [Listener at localhost/44891] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 10:10:20,782 INFO [Listener at localhost/44891] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,785 INFO [Listener at localhost/44891] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,787 INFO [Listener at localhost/44891] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44313 connecting to ZooKeeper ensemble=127.0.0.1:56876 2023-07-19 10:10:20,797 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:443130x0, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 10:10:20,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44313-0x1017d0f8e620002 connected 2023-07-19 10:10:20,801 DEBUG [Listener at localhost/44891] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 10:10:20,803 DEBUG [Listener at localhost/44891] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:10:20,804 DEBUG [Listener at localhost/44891] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 10:10:20,806 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44313 2023-07-19 10:10:20,807 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44313 2023-07-19 10:10:20,811 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44313 2023-07-19 10:10:20,812 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44313 2023-07-19 10:10:20,813 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44313 2023-07-19 10:10:20,829 INFO [Listener at localhost/44891] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 10:10:20,829 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,829 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,829 INFO [Listener at localhost/44891] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 10:10:20,829 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,830 INFO [Listener at localhost/44891] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 10:10:20,830 INFO [Listener at localhost/44891] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 10:10:20,831 INFO [Listener at localhost/44891] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35869 2023-07-19 10:10:20,832 INFO [Listener at localhost/44891] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 10:10:20,834 DEBUG [Listener at localhost/44891] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 10:10:20,836 INFO [Listener at localhost/44891] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,837 INFO [Listener at localhost/44891] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,839 INFO [Listener at localhost/44891] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35869 connecting to ZooKeeper ensemble=127.0.0.1:56876 2023-07-19 10:10:20,844 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:358690x0, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 10:10:20,845 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35869-0x1017d0f8e620003 connected 2023-07-19 10:10:20,845 DEBUG [Listener at localhost/44891] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 10:10:20,846 DEBUG [Listener at localhost/44891] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:10:20,847 DEBUG [Listener at localhost/44891] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 10:10:20,851 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35869 2023-07-19 10:10:20,853 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35869 2023-07-19 10:10:20,855 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35869 2023-07-19 10:10:20,855 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35869 2023-07-19 10:10:20,857 DEBUG [Listener at localhost/44891] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35869 2023-07-19 10:10:20,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40385,1689761419057 2023-07-19 10:10:20,869 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 10:10:20,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40385,1689761419057 2023-07-19 10:10:20,900 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 10:10:20,900 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 10:10:20,900 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 10:10:20,900 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 10:10:20,902 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:20,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 10:10:20,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 10:10:20,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40385,1689761419057 from backup master directory 2023-07-19 10:10:20,910 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40385,1689761419057 2023-07-19 10:10:20,910 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 10:10:20,911 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 10:10:20,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40385,1689761419057 2023-07-19 10:10:20,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-19 10:10:20,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-19 10:10:21,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/hbase.id with ID: 6fe70566-76b4-477d-b3cc-7fcaf843e8c7 2023-07-19 10:10:21,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:21,116 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:21,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3873ce09 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:21,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e2ffddb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:21,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 10:10:21,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-19 10:10:21,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-19 10:10:21,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-19 10:10:21,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 10:10:21,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 10:10:21,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 10:10:21,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/MasterData/data/master/store-tmp 2023-07-19 10:10:21,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:21,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 10:10:21,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:10:21,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:10:21,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 10:10:21,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:10:21,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:10:21,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 10:10:21,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/MasterData/WALs/jenkins-hbase4.apache.org,40385,1689761419057 2023-07-19 10:10:21,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40385%2C1689761419057, suffix=, logDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/MasterData/WALs/jenkins-hbase4.apache.org,40385,1689761419057, archiveDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/MasterData/oldWALs, maxLogs=10 2023-07-19 10:10:21,536 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37877,DS-f1549d69-1a3c-4ed7-95ff-19a04212de66,DISK] 2023-07-19 10:10:21,536 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40889,DS-aa8aa534-c721-4e1a-9c65-f2d9aa5841ab,DISK] 2023-07-19 10:10:21,537 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35901,DS-a91397ee-e121-4ef3-9762-cb7285331846,DISK] 2023-07-19 10:10:21,548 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-19 10:10:21,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/MasterData/WALs/jenkins-hbase4.apache.org,40385,1689761419057/jenkins-hbase4.apache.org%2C40385%2C1689761419057.1689761421463 2023-07-19 10:10:21,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37877,DS-f1549d69-1a3c-4ed7-95ff-19a04212de66,DISK], DatanodeInfoWithStorage[127.0.0.1:40889,DS-aa8aa534-c721-4e1a-9c65-f2d9aa5841ab,DISK], DatanodeInfoWithStorage[127.0.0.1:35901,DS-a91397ee-e121-4ef3-9762-cb7285331846,DISK]] 2023-07-19 10:10:21,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-19 10:10:21,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:21,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 10:10:21,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 10:10:21,752 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-19 10:10:21,763 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-19 10:10:21,803 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-19 10:10:21,817 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:21,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 10:10:21,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 10:10:21,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 10:10:21,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:21,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74996827, jitterRate=0.11753980815410614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:21,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 10:10:21,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-19 10:10:21,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-19 10:10:21,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-19 10:10:21,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-19 10:10:21,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-19 10:10:21,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 37 msec 2023-07-19 10:10:21,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-19 10:10:21,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-19 10:10:21,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-19 10:10:21,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-19 10:10:21,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-19 10:10:21,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-19 10:10:21,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-19 10:10:22,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-19 10:10:22,013 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:22,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-19 10:10:22,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-19 10:10:22,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-19 10:10:22,046 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 10:10:22,046 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:22,046 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 10:10:22,047 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 10:10:22,047 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 10:10:22,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40385,1689761419057, sessionid=0x1017d0f8e620000, setting cluster-up flag (Was=false) 2023-07-19 10:10:22,074 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:22,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-19 10:10:22,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40385,1689761419057 2023-07-19 10:10:22,090 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:22,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-19 10:10:22,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40385,1689761419057 2023-07-19 10:10:22,103 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp 2023-07-19 10:10:22,167 INFO [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(951): ClusterId : 6fe70566-76b4-477d-b3cc-7fcaf843e8c7 2023-07-19 10:10:22,171 INFO [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(951): ClusterId : 6fe70566-76b4-477d-b3cc-7fcaf843e8c7 2023-07-19 10:10:22,174 DEBUG [RS:1;jenkins-hbase4:44313] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 10:10:22,175 DEBUG [RS:2;jenkins-hbase4:35869] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 10:10:22,176 INFO [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(951): ClusterId : 6fe70566-76b4-477d-b3cc-7fcaf843e8c7 2023-07-19 10:10:22,178 DEBUG [RS:0;jenkins-hbase4:35123] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 10:10:22,189 DEBUG [RS:0;jenkins-hbase4:35123] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 10:10:22,189 DEBUG [RS:0;jenkins-hbase4:35123] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 10:10:22,189 DEBUG [RS:2;jenkins-hbase4:35869] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 10:10:22,189 DEBUG [RS:2;jenkins-hbase4:35869] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 10:10:22,189 DEBUG [RS:1;jenkins-hbase4:44313] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 10:10:22,191 DEBUG [RS:1;jenkins-hbase4:44313] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 10:10:22,195 DEBUG [RS:0;jenkins-hbase4:35123] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 10:10:22,199 DEBUG [RS:2;jenkins-hbase4:35869] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 10:10:22,199 DEBUG [RS:1;jenkins-hbase4:44313] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 10:10:22,199 DEBUG [RS:0;jenkins-hbase4:35123] zookeeper.ReadOnlyZKClient(139): Connect 0x75adc386 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:22,205 DEBUG [RS:2;jenkins-hbase4:35869] zookeeper.ReadOnlyZKClient(139): Connect 0x3690d813 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:22,224 DEBUG [RS:1;jenkins-hbase4:44313] zookeeper.ReadOnlyZKClient(139): Connect 0x34925bcb to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:22,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-19 10:10:22,261 DEBUG [RS:2;jenkins-hbase4:35869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@385720b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:22,262 DEBUG [RS:2;jenkins-hbase4:35869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c68b363, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 10:10:22,259 DEBUG [RS:0;jenkins-hbase4:35123] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b6a2343, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:22,263 DEBUG [RS:0;jenkins-hbase4:35123] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f55a8f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 10:10:22,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:22,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-19 10:10:22,306 DEBUG [RS:1;jenkins-hbase4:44313] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a55b329, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:22,306 DEBUG [RS:1;jenkins-hbase4:44313] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b68b912, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 10:10:22,326 DEBUG [RS:0;jenkins-hbase4:35123] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35123 2023-07-19 10:10:22,330 DEBUG [RS:1;jenkins-hbase4:44313] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44313 2023-07-19 10:10:22,335 INFO [RS:1;jenkins-hbase4:44313] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 10:10:22,337 INFO [RS:1;jenkins-hbase4:44313] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 10:10:22,335 INFO [RS:0;jenkins-hbase4:35123] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 10:10:22,337 INFO [RS:0;jenkins-hbase4:35123] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 10:10:22,337 DEBUG [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 10:10:22,337 DEBUG [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 10:10:22,338 INFO [RS:1;jenkins-hbase4:44313] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:22,339 DEBUG [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 10:10:22,339 INFO [RS:0;jenkins-hbase4:35123] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:22,339 DEBUG [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 10:10:22,343 INFO [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40385,1689761419057 with isa=jenkins-hbase4.apache.org/172.31.14.131:44313, startcode=1689761420775 2023-07-19 10:10:22,343 INFO [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40385,1689761419057 with isa=jenkins-hbase4.apache.org/172.31.14.131:35123, startcode=1689761420712 2023-07-19 10:10:22,344 DEBUG [RS:2;jenkins-hbase4:35869] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:35869 2023-07-19 10:10:22,344 INFO [RS:2;jenkins-hbase4:35869] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 10:10:22,344 INFO [RS:2;jenkins-hbase4:35869] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 10:10:22,344 DEBUG [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 10:10:22,345 INFO [RS:2;jenkins-hbase4:35869] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:22,345 DEBUG [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 10:10:22,346 INFO [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40385,1689761419057 with isa=jenkins-hbase4.apache.org/172.31.14.131:35869, startcode=1689761420828 2023-07-19 10:10:22,375 DEBUG [RS:2;jenkins-hbase4:35869] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 10:10:22,375 DEBUG [RS:0;jenkins-hbase4:35123] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 10:10:22,376 DEBUG [RS:1;jenkins-hbase4:44313] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 10:10:22,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-19 10:10:22,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 10:10:22,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 10:10:22,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 10:10:22,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 10:10:22,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-19 10:10:22,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 10:10:22,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689761452442 2023-07-19 10:10:22,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-19 10:10:22,452 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 10:10:22,453 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-19 10:10:22,459 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 10:10:22,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-19 10:10:22,465 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55959, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 10:10:22,465 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38037, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 10:10:22,465 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59375, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 10:10:22,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-19 10:10:22,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-19 10:10:22,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-19 10:10:22,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-19 10:10:22,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-19 10:10:22,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-19 10:10:22,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-19 10:10:22,523 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40385] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 10:10:22,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-19 10:10:22,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-19 10:10:22,563 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40385] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 10:10:22,564 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40385] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 10:10:22,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689761422558,5,FailOnTimeoutGroup] 2023-07-19 10:10:22,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689761422576,5,FailOnTimeoutGroup] 2023-07-19 10:10:22,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-19 10:10:22,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,615 DEBUG [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 10:10:22,616 WARN [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 10:10:22,618 DEBUG [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 10:10:22,618 DEBUG [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 10:10:22,618 WARN [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 10:10:22,618 WARN [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 10:10:22,620 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 10:10:22,621 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 10:10:22,622 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:10:22,661 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:22,665 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 10:10:22,669 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/info 2023-07-19 10:10:22,670 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 10:10:22,673 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:22,674 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 10:10:22,677 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/rep_barrier 2023-07-19 10:10:22,678 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 10:10:22,679 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:22,679 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 10:10:22,682 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/table 2023-07-19 10:10:22,683 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 10:10:22,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:22,689 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740 2023-07-19 10:10:22,690 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740 2023-07-19 10:10:22,695 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 10:10:22,699 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 10:10:22,717 INFO [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40385,1689761419057 with isa=jenkins-hbase4.apache.org/172.31.14.131:35123, startcode=1689761420712 2023-07-19 10:10:22,721 INFO [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40385,1689761419057 with isa=jenkins-hbase4.apache.org/172.31.14.131:44313, startcode=1689761420775 2023-07-19 10:10:22,722 INFO [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40385,1689761419057 with isa=jenkins-hbase4.apache.org/172.31.14.131:35869, startcode=1689761420828 2023-07-19 10:10:22,723 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:22,724 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62376388, jitterRate=-0.07051938772201538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 10:10:22,724 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 10:10:22,724 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 10:10:22,724 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 10:10:22,725 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 10:10:22,725 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 10:10:22,726 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 10:10:22,726 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40385] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:22,735 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40385] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:22,735 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 10:10:22,735 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 10:10:22,741 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40385] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:22,742 DEBUG [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:10:22,743 DEBUG [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35157 2023-07-19 10:10:22,743 DEBUG [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 10:10:22,743 DEBUG [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:10:22,743 DEBUG [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35157 2023-07-19 10:10:22,743 DEBUG [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 10:10:22,756 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:10:22,757 DEBUG [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:10:22,757 DEBUG [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35157 2023-07-19 10:10:22,757 DEBUG [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 10:10:22,763 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 10:10:22,763 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-19 10:10:22,765 DEBUG [RS:1;jenkins-hbase4:44313] zookeeper.ZKUtil(162): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:22,765 WARN [RS:1;jenkins-hbase4:44313] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 10:10:22,765 INFO [RS:1;jenkins-hbase4:44313] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 10:10:22,765 DEBUG [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/WALs/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:22,768 DEBUG [RS:2;jenkins-hbase4:35869] zookeeper.ZKUtil(162): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:22,772 DEBUG [RS:0;jenkins-hbase4:35123] zookeeper.ZKUtil(162): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:22,772 WARN [RS:0;jenkins-hbase4:35123] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 10:10:22,772 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44313,1689761420775] 2023-07-19 10:10:22,772 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35123,1689761420712] 2023-07-19 10:10:22,772 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35869,1689761420828] 2023-07-19 10:10:22,768 WARN [RS:2;jenkins-hbase4:35869] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 10:10:22,773 INFO [RS:2;jenkins-hbase4:35869] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 10:10:22,773 DEBUG [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/WALs/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:22,772 INFO [RS:0;jenkins-hbase4:35123] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 10:10:22,783 DEBUG [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/WALs/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:22,796 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-19 10:10:22,804 DEBUG [RS:1;jenkins-hbase4:44313] zookeeper.ZKUtil(162): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:22,804 DEBUG [RS:0;jenkins-hbase4:35123] zookeeper.ZKUtil(162): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:22,804 DEBUG [RS:2;jenkins-hbase4:35869] zookeeper.ZKUtil(162): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:22,805 DEBUG [RS:2;jenkins-hbase4:35869] zookeeper.ZKUtil(162): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:22,805 DEBUG [RS:0;jenkins-hbase4:35123] zookeeper.ZKUtil(162): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:22,805 DEBUG [RS:1;jenkins-hbase4:44313] zookeeper.ZKUtil(162): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:22,806 DEBUG [RS:2;jenkins-hbase4:35869] zookeeper.ZKUtil(162): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:22,806 DEBUG [RS:1;jenkins-hbase4:44313] zookeeper.ZKUtil(162): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:22,807 DEBUG [RS:0;jenkins-hbase4:35123] zookeeper.ZKUtil(162): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:22,820 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-19 10:10:22,825 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-19 10:10:22,825 DEBUG [RS:0;jenkins-hbase4:35123] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 10:10:22,825 DEBUG [RS:1;jenkins-hbase4:44313] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 10:10:22,825 DEBUG [RS:2;jenkins-hbase4:35869] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 10:10:22,837 INFO [RS:2;jenkins-hbase4:35869] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 10:10:22,839 INFO [RS:1;jenkins-hbase4:44313] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 10:10:22,838 INFO [RS:0;jenkins-hbase4:35123] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 10:10:22,868 INFO [RS:2;jenkins-hbase4:35869] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 10:10:22,869 INFO [RS:0;jenkins-hbase4:35123] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 10:10:22,868 INFO [RS:1;jenkins-hbase4:44313] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 10:10:22,876 INFO [RS:2;jenkins-hbase4:35869] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 10:10:22,876 INFO [RS:1;jenkins-hbase4:44313] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 10:10:22,877 INFO [RS:2;jenkins-hbase4:35869] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,877 INFO [RS:1;jenkins-hbase4:44313] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,876 INFO [RS:0;jenkins-hbase4:35123] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 10:10:22,878 INFO [RS:0;jenkins-hbase4:35123] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,879 INFO [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 10:10:22,882 INFO [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 10:10:22,884 INFO [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 10:10:22,897 INFO [RS:1;jenkins-hbase4:44313] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,897 INFO [RS:0;jenkins-hbase4:35123] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,897 INFO [RS:2;jenkins-hbase4:35869] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,897 DEBUG [RS:1;jenkins-hbase4:44313] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,898 DEBUG [RS:0;jenkins-hbase4:35123] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,898 DEBUG [RS:2;jenkins-hbase4:35869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,898 DEBUG [RS:0;jenkins-hbase4:35123] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,898 DEBUG [RS:2;jenkins-hbase4:35869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,898 DEBUG [RS:0;jenkins-hbase4:35123] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,898 DEBUG [RS:2;jenkins-hbase4:35869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,898 DEBUG [RS:0;jenkins-hbase4:35123] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,898 DEBUG [RS:2;jenkins-hbase4:35869] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,899 DEBUG [RS:0;jenkins-hbase4:35123] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,899 DEBUG [RS:2;jenkins-hbase4:35869] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,899 DEBUG [RS:0;jenkins-hbase4:35123] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 10:10:22,899 DEBUG [RS:2;jenkins-hbase4:35869] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 10:10:22,899 DEBUG [RS:0;jenkins-hbase4:35123] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,899 DEBUG [RS:2;jenkins-hbase4:35869] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,899 DEBUG [RS:0;jenkins-hbase4:35123] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,899 DEBUG [RS:2;jenkins-hbase4:35869] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,899 DEBUG [RS:0;jenkins-hbase4:35123] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,899 DEBUG [RS:2;jenkins-hbase4:35869] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,899 DEBUG [RS:0;jenkins-hbase4:35123] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,899 DEBUG [RS:2;jenkins-hbase4:35869] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,907 DEBUG [RS:1;jenkins-hbase4:44313] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,907 DEBUG [RS:1;jenkins-hbase4:44313] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,907 DEBUG [RS:1;jenkins-hbase4:44313] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,907 DEBUG [RS:1;jenkins-hbase4:44313] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,907 DEBUG [RS:1;jenkins-hbase4:44313] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 10:10:22,907 DEBUG [RS:1;jenkins-hbase4:44313] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,907 DEBUG [RS:1;jenkins-hbase4:44313] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,908 DEBUG [RS:1;jenkins-hbase4:44313] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,908 DEBUG [RS:1;jenkins-hbase4:44313] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,920 INFO [RS:1;jenkins-hbase4:44313] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,920 INFO [RS:1;jenkins-hbase4:44313] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,920 INFO [RS:1;jenkins-hbase4:44313] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,921 INFO [RS:2;jenkins-hbase4:35869] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,921 INFO [RS:2;jenkins-hbase4:35869] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,921 INFO [RS:2;jenkins-hbase4:35869] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,926 INFO [RS:0;jenkins-hbase4:35123] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,927 INFO [RS:0;jenkins-hbase4:35123] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,927 INFO [RS:0;jenkins-hbase4:35123] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,944 INFO [RS:2;jenkins-hbase4:35869] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 10:10:22,944 INFO [RS:0;jenkins-hbase4:35123] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 10:10:22,945 INFO [RS:1;jenkins-hbase4:44313] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 10:10:22,949 INFO [RS:2;jenkins-hbase4:35869] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35869,1689761420828-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,949 INFO [RS:0;jenkins-hbase4:35123] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35123,1689761420712-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,949 INFO [RS:1;jenkins-hbase4:44313] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44313,1689761420775-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,970 INFO [RS:1;jenkins-hbase4:44313] regionserver.Replication(203): jenkins-hbase4.apache.org,44313,1689761420775 started 2023-07-19 10:10:22,970 INFO [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44313,1689761420775, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44313, sessionid=0x1017d0f8e620002 2023-07-19 10:10:22,970 INFO [RS:0;jenkins-hbase4:35123] regionserver.Replication(203): jenkins-hbase4.apache.org,35123,1689761420712 started 2023-07-19 10:10:22,970 DEBUG [RS:1;jenkins-hbase4:44313] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 10:10:22,970 INFO [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35123,1689761420712, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35123, sessionid=0x1017d0f8e620001 2023-07-19 10:10:22,970 DEBUG [RS:1;jenkins-hbase4:44313] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:22,970 DEBUG [RS:0;jenkins-hbase4:35123] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 10:10:22,970 DEBUG [RS:1;jenkins-hbase4:44313] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44313,1689761420775' 2023-07-19 10:10:22,971 DEBUG [RS:0;jenkins-hbase4:35123] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:22,971 DEBUG [RS:1;jenkins-hbase4:44313] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 10:10:22,971 DEBUG [RS:0;jenkins-hbase4:35123] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35123,1689761420712' 2023-07-19 10:10:22,972 DEBUG [RS:0;jenkins-hbase4:35123] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 10:10:22,973 DEBUG [RS:1;jenkins-hbase4:44313] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 10:10:22,973 DEBUG [RS:0;jenkins-hbase4:35123] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 10:10:22,973 DEBUG [RS:0;jenkins-hbase4:35123] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 10:10:22,973 DEBUG [RS:1;jenkins-hbase4:44313] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 10:10:22,974 DEBUG [RS:1;jenkins-hbase4:44313] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 10:10:22,974 DEBUG [RS:0;jenkins-hbase4:35123] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 10:10:22,974 DEBUG [RS:1;jenkins-hbase4:44313] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:22,974 DEBUG [RS:1;jenkins-hbase4:44313] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44313,1689761420775' 2023-07-19 10:10:22,974 DEBUG [RS:1;jenkins-hbase4:44313] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:22,974 DEBUG [RS:0;jenkins-hbase4:35123] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:22,975 INFO [RS:2;jenkins-hbase4:35869] regionserver.Replication(203): jenkins-hbase4.apache.org,35869,1689761420828 started 2023-07-19 10:10:22,975 DEBUG [RS:1;jenkins-hbase4:44313] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:22,975 INFO [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35869,1689761420828, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35869, sessionid=0x1017d0f8e620003 2023-07-19 10:10:22,975 DEBUG [RS:0;jenkins-hbase4:35123] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35123,1689761420712' 2023-07-19 10:10:22,975 DEBUG [RS:2;jenkins-hbase4:35869] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 10:10:22,975 DEBUG [RS:0;jenkins-hbase4:35123] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:22,975 DEBUG [RS:2;jenkins-hbase4:35869] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:22,975 DEBUG [RS:2;jenkins-hbase4:35869] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35869,1689761420828' 2023-07-19 10:10:22,975 DEBUG [RS:2;jenkins-hbase4:35869] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 10:10:22,976 DEBUG [RS:0;jenkins-hbase4:35123] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:22,976 DEBUG [RS:1;jenkins-hbase4:44313] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 10:10:22,976 INFO [RS:1;jenkins-hbase4:44313] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 10:10:22,976 INFO [RS:1;jenkins-hbase4:44313] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 10:10:22,977 DEBUG [RS:2;jenkins-hbase4:35869] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 10:10:22,977 DEBUG [RS:0;jenkins-hbase4:35123] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 10:10:22,977 DEBUG [jenkins-hbase4:40385] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-19 10:10:22,978 DEBUG [RS:2;jenkins-hbase4:35869] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 10:10:22,978 DEBUG [RS:2;jenkins-hbase4:35869] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 10:10:22,978 DEBUG [RS:2;jenkins-hbase4:35869] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:22,978 DEBUG [RS:2;jenkins-hbase4:35869] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35869,1689761420828' 2023-07-19 10:10:22,978 DEBUG [RS:2;jenkins-hbase4:35869] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:22,977 INFO [RS:0;jenkins-hbase4:35123] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 10:10:22,979 INFO [RS:0;jenkins-hbase4:35123] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 10:10:22,979 DEBUG [RS:2;jenkins-hbase4:35869] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:22,980 DEBUG [RS:2;jenkins-hbase4:35869] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 10:10:22,980 INFO [RS:2;jenkins-hbase4:35869] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 10:10:22,980 INFO [RS:2;jenkins-hbase4:35869] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 10:10:22,984 DEBUG [jenkins-hbase4:40385] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:10:22,998 DEBUG [jenkins-hbase4:40385] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:10:22,998 DEBUG [jenkins-hbase4:40385] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:10:22,998 DEBUG [jenkins-hbase4:40385] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:10:22,998 DEBUG [jenkins-hbase4:40385] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:10:23,002 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35869,1689761420828, state=OPENING 2023-07-19 10:10:23,012 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-19 10:10:23,014 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:23,014 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 10:10:23,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35869,1689761420828}] 2023-07-19 10:10:23,094 INFO [RS:0;jenkins-hbase4:35123] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35123%2C1689761420712, suffix=, logDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/WALs/jenkins-hbase4.apache.org,35123,1689761420712, archiveDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/oldWALs, maxLogs=32 2023-07-19 10:10:23,097 INFO [RS:1;jenkins-hbase4:44313] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44313%2C1689761420775, suffix=, logDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/WALs/jenkins-hbase4.apache.org,44313,1689761420775, archiveDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/oldWALs, maxLogs=32 2023-07-19 10:10:23,094 INFO [RS:2;jenkins-hbase4:35869] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35869%2C1689761420828, suffix=, logDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/WALs/jenkins-hbase4.apache.org,35869,1689761420828, archiveDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/oldWALs, maxLogs=32 2023-07-19 10:10:23,167 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35901,DS-a91397ee-e121-4ef3-9762-cb7285331846,DISK] 2023-07-19 10:10:23,167 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40889,DS-aa8aa534-c721-4e1a-9c65-f2d9aa5841ab,DISK] 2023-07-19 10:10:23,168 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37877,DS-f1549d69-1a3c-4ed7-95ff-19a04212de66,DISK] 2023-07-19 10:10:23,168 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40889,DS-aa8aa534-c721-4e1a-9c65-f2d9aa5841ab,DISK] 2023-07-19 10:10:23,169 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37877,DS-f1549d69-1a3c-4ed7-95ff-19a04212de66,DISK] 2023-07-19 10:10:23,170 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40889,DS-aa8aa534-c721-4e1a-9c65-f2d9aa5841ab,DISK] 2023-07-19 10:10:23,171 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37877,DS-f1549d69-1a3c-4ed7-95ff-19a04212de66,DISK] 2023-07-19 10:10:23,171 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35901,DS-a91397ee-e121-4ef3-9762-cb7285331846,DISK] 2023-07-19 10:10:23,174 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35901,DS-a91397ee-e121-4ef3-9762-cb7285331846,DISK] 2023-07-19 10:10:23,185 INFO [RS:2;jenkins-hbase4:35869] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/WALs/jenkins-hbase4.apache.org,35869,1689761420828/jenkins-hbase4.apache.org%2C35869%2C1689761420828.1689761423105 2023-07-19 10:10:23,185 INFO [RS:0;jenkins-hbase4:35123] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/WALs/jenkins-hbase4.apache.org,35123,1689761420712/jenkins-hbase4.apache.org%2C35123%2C1689761420712.1689761423104 2023-07-19 10:10:23,187 DEBUG [RS:2;jenkins-hbase4:35869] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35901,DS-a91397ee-e121-4ef3-9762-cb7285331846,DISK], DatanodeInfoWithStorage[127.0.0.1:37877,DS-f1549d69-1a3c-4ed7-95ff-19a04212de66,DISK], DatanodeInfoWithStorage[127.0.0.1:40889,DS-aa8aa534-c721-4e1a-9c65-f2d9aa5841ab,DISK]] 2023-07-19 10:10:23,187 INFO [RS:1;jenkins-hbase4:44313] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/WALs/jenkins-hbase4.apache.org,44313,1689761420775/jenkins-hbase4.apache.org%2C44313%2C1689761420775.1689761423105 2023-07-19 10:10:23,189 DEBUG [RS:0;jenkins-hbase4:35123] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40889,DS-aa8aa534-c721-4e1a-9c65-f2d9aa5841ab,DISK], DatanodeInfoWithStorage[127.0.0.1:35901,DS-a91397ee-e121-4ef3-9762-cb7285331846,DISK], DatanodeInfoWithStorage[127.0.0.1:37877,DS-f1549d69-1a3c-4ed7-95ff-19a04212de66,DISK]] 2023-07-19 10:10:23,189 DEBUG [RS:1;jenkins-hbase4:44313] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40889,DS-aa8aa534-c721-4e1a-9c65-f2d9aa5841ab,DISK], DatanodeInfoWithStorage[127.0.0.1:37877,DS-f1549d69-1a3c-4ed7-95ff-19a04212de66,DISK], DatanodeInfoWithStorage[127.0.0.1:35901,DS-a91397ee-e121-4ef3-9762-cb7285331846,DISK]] 2023-07-19 10:10:23,214 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:23,217 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 10:10:23,219 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 10:10:23,232 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-19 10:10:23,234 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 10:10:23,237 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35869%2C1689761420828.meta, suffix=.meta, logDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/WALs/jenkins-hbase4.apache.org,35869,1689761420828, archiveDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/oldWALs, maxLogs=32 2023-07-19 10:10:23,263 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35901,DS-a91397ee-e121-4ef3-9762-cb7285331846,DISK] 2023-07-19 10:10:23,266 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37877,DS-f1549d69-1a3c-4ed7-95ff-19a04212de66,DISK] 2023-07-19 10:10:23,266 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40889,DS-aa8aa534-c721-4e1a-9c65-f2d9aa5841ab,DISK] 2023-07-19 10:10:23,276 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/WALs/jenkins-hbase4.apache.org,35869,1689761420828/jenkins-hbase4.apache.org%2C35869%2C1689761420828.meta.1689761423239.meta 2023-07-19 10:10:23,278 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35901,DS-a91397ee-e121-4ef3-9762-cb7285331846,DISK], DatanodeInfoWithStorage[127.0.0.1:37877,DS-f1549d69-1a3c-4ed7-95ff-19a04212de66,DISK], DatanodeInfoWithStorage[127.0.0.1:40889,DS-aa8aa534-c721-4e1a-9c65-f2d9aa5841ab,DISK]] 2023-07-19 10:10:23,279 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-19 10:10:23,280 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-19 10:10:23,281 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:23,282 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-19 10:10:23,285 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-19 10:10:23,286 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-19 10:10:23,303 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-19 10:10:23,303 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:23,304 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-19 10:10:23,304 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-19 10:10:23,307 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 10:10:23,310 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/info 2023-07-19 10:10:23,311 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/info 2023-07-19 10:10:23,311 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 10:10:23,317 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:23,317 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 10:10:23,320 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/rep_barrier 2023-07-19 10:10:23,320 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/rep_barrier 2023-07-19 10:10:23,321 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 10:10:23,322 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:23,322 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 10:10:23,324 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/table 2023-07-19 10:10:23,324 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/table 2023-07-19 10:10:23,324 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 10:10:23,325 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:23,327 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740 2023-07-19 10:10:23,331 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740 2023-07-19 10:10:23,335 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 10:10:23,338 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 10:10:23,339 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61587606, jitterRate=-0.08227315545082092}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 10:10:23,342 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 10:10:23,359 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689761423204 2023-07-19 10:10:23,390 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35869,1689761420828, state=OPEN 2023-07-19 10:10:23,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-19 10:10:23,398 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-19 10:10:23,402 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-19 10:10:23,403 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 10:10:23,410 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-19 10:10:23,410 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35869,1689761420828 in 384 msec 2023-07-19 10:10:23,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-19 10:10:23,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 616 msec 2023-07-19 10:10:23,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1290 sec 2023-07-19 10:10:23,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689761423434, completionTime=-1 2023-07-19 10:10:23,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-19 10:10:23,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-19 10:10:23,514 DEBUG [hconnection-0x484fc19a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:23,519 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:23,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-19 10:10:23,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689761483555 2023-07-19 10:10:23,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689761543555 2023-07-19 10:10:23,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 120 msec 2023-07-19 10:10:23,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40385,1689761419057-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:23,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40385,1689761419057-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:23,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40385,1689761419057-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:23,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40385, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:23,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:23,598 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 10:10:23,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-19 10:10:23,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 10:10:23,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-19 10:10:23,637 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:10:23,642 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:10:23,671 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/hbase/namespace/60af2c5090478026d6317dcb9316d471 2023-07-19 10:10:23,675 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/hbase/namespace/60af2c5090478026d6317dcb9316d471 empty. 2023-07-19 10:10:23,676 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/hbase/namespace/60af2c5090478026d6317dcb9316d471 2023-07-19 10:10:23,676 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-19 10:10:23,752 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-19 10:10:23,755 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 60af2c5090478026d6317dcb9316d471, NAME => 'hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:10:23,795 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:23,795 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 60af2c5090478026d6317dcb9316d471, disabling compactions & flushes 2023-07-19 10:10:23,795 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. 2023-07-19 10:10:23,795 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. 2023-07-19 10:10:23,795 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. after waiting 0 ms 2023-07-19 10:10:23,795 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. 2023-07-19 10:10:23,795 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. 2023-07-19 10:10:23,795 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 60af2c5090478026d6317dcb9316d471: 2023-07-19 10:10:23,801 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:10:23,820 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689761423805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761423805"}]},"ts":"1689761423805"} 2023-07-19 10:10:23,853 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 10:10:23,856 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:10:23,862 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761423857"}]},"ts":"1689761423857"} 2023-07-19 10:10:23,867 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-19 10:10:23,872 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:10:23,874 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:10:23,874 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:10:23,874 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:10:23,874 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:10:23,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=60af2c5090478026d6317dcb9316d471, ASSIGN}] 2023-07-19 10:10:23,883 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=60af2c5090478026d6317dcb9316d471, ASSIGN 2023-07-19 10:10:23,885 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=60af2c5090478026d6317dcb9316d471, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44313,1689761420775; forceNewPlan=false, retain=false 2023-07-19 10:10:24,038 INFO [jenkins-hbase4:40385] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 10:10:24,039 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=60af2c5090478026d6317dcb9316d471, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:24,039 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689761424039"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761424039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761424039"}]},"ts":"1689761424039"} 2023-07-19 10:10:24,050 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 60af2c5090478026d6317dcb9316d471, server=jenkins-hbase4.apache.org,44313,1689761420775}] 2023-07-19 10:10:24,205 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:24,205 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 10:10:24,208 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 10:10:24,214 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. 2023-07-19 10:10:24,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 60af2c5090478026d6317dcb9316d471, NAME => 'hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471.', STARTKEY => '', ENDKEY => ''} 2023-07-19 10:10:24,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. service=AccessControlService 2023-07-19 10:10:24,215 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:24,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 60af2c5090478026d6317dcb9316d471 2023-07-19 10:10:24,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:24,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 60af2c5090478026d6317dcb9316d471 2023-07-19 10:10:24,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 60af2c5090478026d6317dcb9316d471 2023-07-19 10:10:24,218 INFO [StoreOpener-60af2c5090478026d6317dcb9316d471-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 60af2c5090478026d6317dcb9316d471 2023-07-19 10:10:24,220 DEBUG [StoreOpener-60af2c5090478026d6317dcb9316d471-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/namespace/60af2c5090478026d6317dcb9316d471/info 2023-07-19 10:10:24,221 DEBUG [StoreOpener-60af2c5090478026d6317dcb9316d471-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/namespace/60af2c5090478026d6317dcb9316d471/info 2023-07-19 10:10:24,221 INFO [StoreOpener-60af2c5090478026d6317dcb9316d471-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60af2c5090478026d6317dcb9316d471 columnFamilyName info 2023-07-19 10:10:24,222 INFO [StoreOpener-60af2c5090478026d6317dcb9316d471-1] regionserver.HStore(310): Store=60af2c5090478026d6317dcb9316d471/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:24,223 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/namespace/60af2c5090478026d6317dcb9316d471 2023-07-19 10:10:24,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/namespace/60af2c5090478026d6317dcb9316d471 2023-07-19 10:10:24,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 60af2c5090478026d6317dcb9316d471 2023-07-19 10:10:24,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/namespace/60af2c5090478026d6317dcb9316d471/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:24,233 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 60af2c5090478026d6317dcb9316d471; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67737186, jitterRate=0.009362727403640747}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:24,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 60af2c5090478026d6317dcb9316d471: 2023-07-19 10:10:24,236 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471., pid=6, masterSystemTime=1689761424205 2023-07-19 10:10:24,242 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. 2023-07-19 10:10:24,242 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. 2023-07-19 10:10:24,244 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=60af2c5090478026d6317dcb9316d471, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:24,244 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689761424243"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761424243"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761424243"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761424243"}]},"ts":"1689761424243"} 2023-07-19 10:10:24,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-19 10:10:24,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 60af2c5090478026d6317dcb9316d471, server=jenkins-hbase4.apache.org,44313,1689761420775 in 197 msec 2023-07-19 10:10:24,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-19 10:10:24,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=60af2c5090478026d6317dcb9316d471, ASSIGN in 374 msec 2023-07-19 10:10:24,256 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:10:24,257 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761424256"}]},"ts":"1689761424256"} 2023-07-19 10:10:24,259 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-19 10:10:24,263 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:10:24,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 650 msec 2023-07-19 10:10:24,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-19 10:10:24,339 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-19 10:10:24,339 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:24,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:24,368 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:24,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-19 10:10:24,404 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 10:10:24,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-07-19 10:10:24,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-19 10:10:24,441 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 10:10:24,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-19 10:10:24,454 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-19 10:10:24,457 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-19 10:10:24,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.547sec 2023-07-19 10:10:24,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-19 10:10:24,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-19 10:10:24,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-19 10:10:24,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40385,1689761419057-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-19 10:10:24,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40385,1689761419057-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-19 10:10:24,468 DEBUG [Listener at localhost/44891] zookeeper.ReadOnlyZKClient(139): Connect 0x3c9a8426 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:24,478 DEBUG [Listener at localhost/44891] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b044b2a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:24,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 10:10:24,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-19 10:10:24,495 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:10:24,497 DEBUG [hconnection-0x6a74b11c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:24,498 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:10:24,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-19 10:10:24,500 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/hbase/acl/e4b85c49b4add775223ef0908b5152fe 2023-07-19 10:10:24,502 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/hbase/acl/e4b85c49b4add775223ef0908b5152fe empty. 2023-07-19 10:10:24,504 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/hbase/acl/e4b85c49b4add775223ef0908b5152fe 2023-07-19 10:10:24,504 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-19 10:10:24,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 10:10:24,514 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:24,518 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40385,1689761419057 2023-07-19 10:10:24,518 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-19 10:10:24,518 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/test.cache.data in system properties and HBase conf 2023-07-19 10:10:24,518 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 10:10:24,518 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop.log.dir in system properties and HBase conf 2023-07-19 10:10:24,518 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 10:10:24,518 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 10:10:24,518 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 10:10:24,519 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 10:10:24,519 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 10:10:24,519 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 10:10:24,519 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 10:10:24,519 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 10:10:24,519 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 10:10:24,519 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 10:10:24,519 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 10:10:24,520 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 10:10:24,520 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/nfs.dump.dir in system properties and HBase conf 2023-07-19 10:10:24,520 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/java.io.tmpdir in system properties and HBase conf 2023-07-19 10:10:24,520 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 10:10:24,520 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 10:10:24,520 INFO [Listener at localhost/44891] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-19 10:10:24,549 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-19 10:10:24,552 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => e4b85c49b4add775223ef0908b5152fe, NAME => 'hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:10:24,615 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:24,615 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing e4b85c49b4add775223ef0908b5152fe, disabling compactions & flushes 2023-07-19 10:10:24,615 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. 2023-07-19 10:10:24,615 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. 2023-07-19 10:10:24,615 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. after waiting 0 ms 2023-07-19 10:10:24,615 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. 2023-07-19 10:10:24,615 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. 2023-07-19 10:10:24,616 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for e4b85c49b4add775223ef0908b5152fe: 2023-07-19 10:10:24,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 10:10:24,627 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:10:24,631 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689761424630"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761424630"}]},"ts":"1689761424630"} 2023-07-19 10:10:24,635 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 10:10:24,639 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:10:24,639 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761424639"}]},"ts":"1689761424639"} 2023-07-19 10:10:24,646 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-19 10:10:24,654 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:10:24,656 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:10:24,656 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:10:24,656 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:10:24,656 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:10:24,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e4b85c49b4add775223ef0908b5152fe, ASSIGN}] 2023-07-19 10:10:24,665 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e4b85c49b4add775223ef0908b5152fe, ASSIGN 2023-07-19 10:10:24,667 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=e4b85c49b4add775223ef0908b5152fe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44313,1689761420775; forceNewPlan=false, retain=false 2023-07-19 10:10:24,817 INFO [jenkins-hbase4:40385] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 10:10:24,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 10:10:24,819 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e4b85c49b4add775223ef0908b5152fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:24,819 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689761424819"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761424819"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761424819"}]},"ts":"1689761424819"} 2023-07-19 10:10:24,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e4b85c49b4add775223ef0908b5152fe, server=jenkins-hbase4.apache.org,44313,1689761420775}] 2023-07-19 10:10:24,985 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. 2023-07-19 10:10:24,985 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4b85c49b4add775223ef0908b5152fe, NAME => 'hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe.', STARTKEY => '', ENDKEY => ''} 2023-07-19 10:10:24,985 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. service=AccessControlService 2023-07-19 10:10:24,986 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:24,986 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl e4b85c49b4add775223ef0908b5152fe 2023-07-19 10:10:24,986 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:24,986 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4b85c49b4add775223ef0908b5152fe 2023-07-19 10:10:24,986 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4b85c49b4add775223ef0908b5152fe 2023-07-19 10:10:24,994 INFO [StoreOpener-e4b85c49b4add775223ef0908b5152fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region e4b85c49b4add775223ef0908b5152fe 2023-07-19 10:10:24,998 DEBUG [StoreOpener-e4b85c49b4add775223ef0908b5152fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/acl/e4b85c49b4add775223ef0908b5152fe/l 2023-07-19 10:10:24,998 DEBUG [StoreOpener-e4b85c49b4add775223ef0908b5152fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/acl/e4b85c49b4add775223ef0908b5152fe/l 2023-07-19 10:10:24,999 INFO [StoreOpener-e4b85c49b4add775223ef0908b5152fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4b85c49b4add775223ef0908b5152fe columnFamilyName l 2023-07-19 10:10:25,001 INFO [StoreOpener-e4b85c49b4add775223ef0908b5152fe-1] regionserver.HStore(310): Store=e4b85c49b4add775223ef0908b5152fe/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:25,005 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/acl/e4b85c49b4add775223ef0908b5152fe 2023-07-19 10:10:25,009 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/acl/e4b85c49b4add775223ef0908b5152fe 2023-07-19 10:10:25,017 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4b85c49b4add775223ef0908b5152fe 2023-07-19 10:10:25,024 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/acl/e4b85c49b4add775223ef0908b5152fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:25,025 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4b85c49b4add775223ef0908b5152fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65652290, jitterRate=-0.021704643964767456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:25,026 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4b85c49b4add775223ef0908b5152fe: 2023-07-19 10:10:25,028 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe., pid=11, masterSystemTime=1689761424977 2023-07-19 10:10:25,032 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. 2023-07-19 10:10:25,032 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. 2023-07-19 10:10:25,047 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e4b85c49b4add775223ef0908b5152fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:25,047 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689761425047"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761425047"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761425047"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761425047"}]},"ts":"1689761425047"} 2023-07-19 10:10:25,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-19 10:10:25,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e4b85c49b4add775223ef0908b5152fe, server=jenkins-hbase4.apache.org,44313,1689761420775 in 228 msec 2023-07-19 10:10:25,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-19 10:10:25,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=e4b85c49b4add775223ef0908b5152fe, ASSIGN in 401 msec 2023-07-19 10:10:25,066 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:10:25,067 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761425066"}]},"ts":"1689761425066"} 2023-07-19 10:10:25,069 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-19 10:10:25,074 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:10:25,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 583 msec 2023-07-19 10:10:25,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 10:10:25,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-19 10:10:25,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-19 10:10:26,053 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:26,475 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:26,482 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35087_jobhistory____kvhlo6/webapp 2023-07-19 10:10:26,697 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-19 10:10:26,697 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-19 10:10:26,697 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 10:10:26,700 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 10:10:26,796 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:27,183 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:27,792 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-19 10:10:27,855 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35087 2023-07-19 10:10:28,862 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:10:29,077 WARN [Listener at jenkins-hbase4.apache.org/36321] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:29,138 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-19 10:10:29,139 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-19 10:10:29,140 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-19 10:10:29,199 WARN [Listener at jenkins-hbase4.apache.org/36321] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 10:10:29,200 INFO [Listener at jenkins-hbase4.apache.org/36321] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:29,232 INFO [Listener at jenkins-hbase4.apache.org/36321] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42235_cluster____.3waynm/webapp 2023-07-19 10:10:29,257 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:10:29,257 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-19 10:10:29,258 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:10:29,258 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-19 10:10:29,258 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 10:10:29,258 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-19 10:10:29,259 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:10:29,259 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-19 10:10:29,259 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 10:10:29,259 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-19 10:10:29,322 INFO [Listener at jenkins-hbase4.apache.org/36321] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 10:10:29,322 INFO [Listener at jenkins-hbase4.apache.org/36321] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-19 10:10:29,322 INFO [Listener at jenkins-hbase4.apache.org/36321] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 10:10:29,323 INFO [Listener at jenkins-hbase4.apache.org/36321] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 10:10:29,335 INFO [Listener at jenkins-hbase4.apache.org/36321] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:29,555 INFO [Listener at jenkins-hbase4.apache.org/36321] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:29,697 INFO [Listener at jenkins-hbase4.apache.org/36321] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:29,707 INFO [Listener at jenkins-hbase4.apache.org/36321] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42235 2023-07-19 10:10:30,233 WARN [Listener at jenkins-hbase4.apache.org/36241] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:30,264 WARN [Listener at jenkins-hbase4.apache.org/36241] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 10:10:30,264 INFO [Listener at jenkins-hbase4.apache.org/36241] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:30,274 INFO [Listener at jenkins-hbase4.apache.org/36241] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43293_node____gy7ne3/webapp 2023-07-19 10:10:30,329 INFO [Listener at jenkins-hbase4.apache.org/36241] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 10:10:30,329 INFO [Listener at jenkins-hbase4.apache.org/36241] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 10:10:30,329 INFO [Listener at jenkins-hbase4.apache.org/36241] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 10:10:30,329 INFO [Listener at jenkins-hbase4.apache.org/36241] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 10:10:30,340 INFO [Listener at jenkins-hbase4.apache.org/36241] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:30,367 INFO [Listener at jenkins-hbase4.apache.org/36241] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:30,469 INFO [Listener at jenkins-hbase4.apache.org/36241] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:30,484 INFO [Listener at jenkins-hbase4.apache.org/36241] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43293 2023-07-19 10:10:30,790 WARN [Listener at jenkins-hbase4.apache.org/37821] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:30,798 WARN [Listener at jenkins-hbase4.apache.org/37821] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 10:10:30,798 INFO [Listener at jenkins-hbase4.apache.org/37821] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:30,809 INFO [Listener at jenkins-hbase4.apache.org/37821] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37121_node____j5nre/webapp 2023-07-19 10:10:30,864 INFO [Listener at jenkins-hbase4.apache.org/37821] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 10:10:30,864 INFO [Listener at jenkins-hbase4.apache.org/37821] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 10:10:30,864 INFO [Listener at jenkins-hbase4.apache.org/37821] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 10:10:30,864 INFO [Listener at jenkins-hbase4.apache.org/37821] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 10:10:30,873 INFO [Listener at jenkins-hbase4.apache.org/37821] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:30,886 INFO [Listener at jenkins-hbase4.apache.org/37821] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:30,970 INFO [Listener at jenkins-hbase4.apache.org/37821] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:30,979 INFO [Listener at jenkins-hbase4.apache.org/37821] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37121 2023-07-19 10:10:31,011 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-19 10:10:31,013 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:10:31,102 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=299, ProcessCount=175, AvailableMemoryMB=4909 2023-07-19 10:10:31,103 WARN [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-19 10:10:31,120 DEBUG [Listener at jenkins-hbase4.apache.org/37821] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 10:10:31,127 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 10:10:31,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 10:10:31,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:31,142 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:10:31,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-19 10:10:31,144 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:10:31,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 10:10:31,149 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1 2023-07-19 10:10:31,150 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1 empty. 2023-07-19 10:10:31,151 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4 2023-07-19 10:10:31,151 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1 2023-07-19 10:10:31,153 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4 empty. 2023-07-19 10:10:31,154 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4 2023-07-19 10:10:31,154 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 10:10:31,189 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-19 10:10:31,191 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 10a97e9627352fc9858789647dd18fe4, NAME => 'testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:10:31,191 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 739de6c6ca468ebc4e2a8be8a1d682b1, NAME => 'testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:10:31,235 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:31,235 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 739de6c6ca468ebc4e2a8be8a1d682b1, disabling compactions & flushes 2023-07-19 10:10:31,235 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:31,235 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:31,235 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:31,235 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. after waiting 0 ms 2023-07-19 10:10:31,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 10a97e9627352fc9858789647dd18fe4, disabling compactions & flushes 2023-07-19 10:10:31,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:31,237 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:31,237 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:31,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:31,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 739de6c6ca468ebc4e2a8be8a1d682b1: 2023-07-19 10:10:31,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. after waiting 0 ms 2023-07-19 10:10:31,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:31,237 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:31,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 10a97e9627352fc9858789647dd18fe4: 2023-07-19 10:10:31,241 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:10:31,243 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761431243"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761431243"}]},"ts":"1689761431243"} 2023-07-19 10:10:31,243 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761431243"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761431243"}]},"ts":"1689761431243"} 2023-07-19 10:10:31,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 10:10:31,301 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:10:31,304 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:10:31,304 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761431304"}]},"ts":"1689761431304"} 2023-07-19 10:10:31,307 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-19 10:10:31,314 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:10:31,317 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:10:31,317 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:10:31,317 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:10:31,317 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:10:31,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=739de6c6ca468ebc4e2a8be8a1d682b1, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=10a97e9627352fc9858789647dd18fe4, ASSIGN}] 2023-07-19 10:10:31,323 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=10a97e9627352fc9858789647dd18fe4, ASSIGN 2023-07-19 10:10:31,323 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=739de6c6ca468ebc4e2a8be8a1d682b1, ASSIGN 2023-07-19 10:10:31,325 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=739de6c6ca468ebc4e2a8be8a1d682b1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35123,1689761420712; forceNewPlan=false, retain=false 2023-07-19 10:10:31,325 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=10a97e9627352fc9858789647dd18fe4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35869,1689761420828; forceNewPlan=false, retain=false 2023-07-19 10:10:31,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 10:10:31,475 INFO [jenkins-hbase4:40385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:10:31,478 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=739de6c6ca468ebc4e2a8be8a1d682b1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:31,478 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=10a97e9627352fc9858789647dd18fe4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:31,478 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761431478"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761431478"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761431478"}]},"ts":"1689761431478"} 2023-07-19 10:10:31,478 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761431478"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761431478"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761431478"}]},"ts":"1689761431478"} 2023-07-19 10:10:31,481 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 739de6c6ca468ebc4e2a8be8a1d682b1, server=jenkins-hbase4.apache.org,35123,1689761420712}] 2023-07-19 10:10:31,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 10a97e9627352fc9858789647dd18fe4, server=jenkins-hbase4.apache.org,35869,1689761420828}] 2023-07-19 10:10:31,635 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:31,636 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 10:10:31,640 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 10:10:31,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:31,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 10a97e9627352fc9858789647dd18fe4, NAME => 'testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 10:10:31,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. service=AccessControlService 2023-07-19 10:10:31,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:31,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 10a97e9627352fc9858789647dd18fe4 2023-07-19 10:10:31,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:31,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 10a97e9627352fc9858789647dd18fe4 2023-07-19 10:10:31,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 10a97e9627352fc9858789647dd18fe4 2023-07-19 10:10:31,652 INFO [StoreOpener-10a97e9627352fc9858789647dd18fe4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 10a97e9627352fc9858789647dd18fe4 2023-07-19 10:10:31,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:31,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 739de6c6ca468ebc4e2a8be8a1d682b1, NAME => 'testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 10:10:31,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. service=AccessControlService 2023-07-19 10:10:31,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:31,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 739de6c6ca468ebc4e2a8be8a1d682b1 2023-07-19 10:10:31,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:31,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 739de6c6ca468ebc4e2a8be8a1d682b1 2023-07-19 10:10:31,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 739de6c6ca468ebc4e2a8be8a1d682b1 2023-07-19 10:10:31,655 DEBUG [StoreOpener-10a97e9627352fc9858789647dd18fe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/cf 2023-07-19 10:10:31,655 DEBUG [StoreOpener-10a97e9627352fc9858789647dd18fe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/cf 2023-07-19 10:10:31,656 INFO [StoreOpener-10a97e9627352fc9858789647dd18fe4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10a97e9627352fc9858789647dd18fe4 columnFamilyName cf 2023-07-19 10:10:31,659 INFO [StoreOpener-10a97e9627352fc9858789647dd18fe4-1] regionserver.HStore(310): Store=10a97e9627352fc9858789647dd18fe4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:31,662 INFO [StoreOpener-739de6c6ca468ebc4e2a8be8a1d682b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 739de6c6ca468ebc4e2a8be8a1d682b1 2023-07-19 10:10:31,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4 2023-07-19 10:10:31,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4 2023-07-19 10:10:31,666 DEBUG [StoreOpener-739de6c6ca468ebc4e2a8be8a1d682b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/cf 2023-07-19 10:10:31,666 DEBUG [StoreOpener-739de6c6ca468ebc4e2a8be8a1d682b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/cf 2023-07-19 10:10:31,667 INFO [StoreOpener-739de6c6ca468ebc4e2a8be8a1d682b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 739de6c6ca468ebc4e2a8be8a1d682b1 columnFamilyName cf 2023-07-19 10:10:31,668 INFO [StoreOpener-739de6c6ca468ebc4e2a8be8a1d682b1-1] regionserver.HStore(310): Store=739de6c6ca468ebc4e2a8be8a1d682b1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:31,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1 2023-07-19 10:10:31,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1 2023-07-19 10:10:31,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 10a97e9627352fc9858789647dd18fe4 2023-07-19 10:10:31,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 739de6c6ca468ebc4e2a8be8a1d682b1 2023-07-19 10:10:31,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:31,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:31,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 10a97e9627352fc9858789647dd18fe4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64609546, jitterRate=-0.037242740392684937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:31,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 10a97e9627352fc9858789647dd18fe4: 2023-07-19 10:10:31,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 739de6c6ca468ebc4e2a8be8a1d682b1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64838679, jitterRate=-0.03382839262485504}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:31,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 739de6c6ca468ebc4e2a8be8a1d682b1: 2023-07-19 10:10:31,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4., pid=16, masterSystemTime=1689761431636 2023-07-19 10:10:31,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:31,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:31,695 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=10a97e9627352fc9858789647dd18fe4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:31,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1., pid=15, masterSystemTime=1689761431635 2023-07-19 10:10:31,696 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761431695"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761431695"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761431695"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761431695"}]},"ts":"1689761431695"} 2023-07-19 10:10:31,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:31,703 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=739de6c6ca468ebc4e2a8be8a1d682b1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:31,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:31,704 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761431703"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761431703"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761431703"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761431703"}]},"ts":"1689761431703"} 2023-07-19 10:10:31,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-19 10:10:31,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 10a97e9627352fc9858789647dd18fe4, server=jenkins-hbase4.apache.org,35869,1689761420828 in 219 msec 2023-07-19 10:10:31,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=10a97e9627352fc9858789647dd18fe4, ASSIGN in 390 msec 2023-07-19 10:10:31,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-19 10:10:31,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 739de6c6ca468ebc4e2a8be8a1d682b1, server=jenkins-hbase4.apache.org,35123,1689761420712 in 226 msec 2023-07-19 10:10:31,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-19 10:10:31,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=739de6c6ca468ebc4e2a8be8a1d682b1, ASSIGN in 394 msec 2023-07-19 10:10:31,717 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:10:31,717 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761431717"}]},"ts":"1689761431717"} 2023-07-19 10:10:31,719 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-19 10:10:31,723 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:10:31,729 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-19 10:10:31,741 DEBUG [hconnection-0x5eb1ab3a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:31,745 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-19 10:10:31,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 10:10:31,771 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 10:10:31,814 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:31,814 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:31,814 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:31,814 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:31,814 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:31,822 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:31,822 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:31,830 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:31,830 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:31,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:31,834 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:31,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:31,838 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 699 msec 2023-07-19 10:10:32,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 10:10:32,255 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-19 10:10:32,255 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-19 10:10:32,256 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:10:32,260 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-19 10:10:32,261 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:10:32,261 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-19 10:10:32,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 10:10:32,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761432276 (current time:1689761432276). 2023-07-19 10:10:32,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:10:32,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x3393fc5f to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:32,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@351b5040, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:32,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:32,286 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:32,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3393fc5f to 127.0.0.1:56876 2023-07-19 10:10:32,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:32,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x27d1306d to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:32,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50b3cdb4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:32,296 DEBUG [hconnection-0x60b491ee-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:32,298 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:32,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:32,303 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:32,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27d1306d to 127.0.0.1:56876 2023-07-19 10:10:32,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:32,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 10:10:32,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:10:32,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 10:10:32,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 10:10:32,353 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 10:10:32,355 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689762032355 2023-07-19 10:10:32,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 10:10:32,359 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 10:10:32,366 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 10:10:32,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 10:10:32,368 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:10:32,368 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:10:32,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 24 msec 2023-07-19 10:10:32,371 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 10:10:32,373 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689762032373 2023-07-19 10:10:32,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,415 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-19 10:10:32,415 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:32,416 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 10:10:32,416 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 10:10:32,417 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,417 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,422 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:32,422 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:32,422 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,422 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:32,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:32,423 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,423 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,424 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,424 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:10:32,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 10:10:32,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:32,425 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 10:10:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 10:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 10:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,426 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 10:10:32,426 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 10:10:32,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,429 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 10:10:32,429 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:32,429 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 10:10:32,430 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 10:10:32,430 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:32,430 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 10:10:32,432 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 10:10:32,432 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 10:10:32,430 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 10:10:32,432 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 10:10:32,432 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:32,432 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 10:10:32,433 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 10:10:32,433 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 10:10:32,433 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 10:10:32,437 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,437 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:32,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:32,438 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,438 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:32,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:32,439 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,439 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:32,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:32,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 10:10:32,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64cb79ef[Count = 1] remaining members to acquire global barrier 2023-07-19 10:10:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:32,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:32,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:32,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:32,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:32,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:32,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 10:10:32,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64cb79ef[Count = 0] remaining members to acquire global barrier 2023-07-19 10:10:32,446 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 10:10:32,446 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,449 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,450 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 10:10:32,450 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,450 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 10:10:32,450 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 10:10:32,450 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44313,1689761420775' in zk 2023-07-19 10:10:32,450 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,451 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,451 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:10:32,453 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,458 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:32,459 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:32,461 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:32,460 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 10:10:32,461 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:32,461 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 10:10:32,461 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:32,461 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:32,461 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:32,461 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 10:10:32,463 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. started... 2023-07-19 10:10:32,463 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. started... 2023-07-19 10:10:32,468 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 739de6c6ca468ebc4e2a8be8a1d682b1: 2023-07-19 10:10:32,468 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 10a97e9627352fc9858789647dd18fe4: 2023-07-19 10:10:32,468 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:32,469 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,469 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 10:10:32,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:32,475 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:10:32,476 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:32,476 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:32,480 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:10:32,480 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:10:32,524 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. completed. 2023-07-19 10:10:32,524 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 10:10:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35869,1689761420828' in zk 2023-07-19 10:10:32,525 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. completed. 2023-07-19 10:10:32,525 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:32,526 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:32,526 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:32,526 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,526 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 10:10:32,526 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35123,1689761420712' in zk 2023-07-19 10:10:32,527 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,527 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 10:10:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:32,527 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:32,527 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 10:10:32,529 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 10:10:32,529 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:32,529 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 10:10:32,530 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:32,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:32,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:32,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:32,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35869,1689761420828': 2023-07-19 10:10:32,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 10:10:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:32,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:32,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35123,1689761420712': 2023-07-19 10:10:32,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 10:10:32,544 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-19 10:10:32,544 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:10:32,544 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:10:32,544 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,544 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:10:32,548 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,548 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,548 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,548 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:32,548 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,548 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:32,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:32,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:32,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:32,548 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:32,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:32,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:32,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:32,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:32,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:32,549 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:32,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:32,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,550 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,550 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:32,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:32,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,553 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:32,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:32,553 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,554 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:32,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,574 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,575 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:32,575 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:32,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:32,575 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:32,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:32,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:32,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:32,575 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:32,575 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,575 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:32,575 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:32,575 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:32,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:32,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:32,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,575 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:32,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:32,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:32,575 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:32,575 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:32,576 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:32,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:32,577 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:32,577 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,577 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:32,577 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:32,577 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,577 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,675 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:32,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 10:10:32,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:32,677 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:10:32,685 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 10:10:32,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,686 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689761432359Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689761432575 (+216 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689761432576 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689761432589 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689761432613 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689761432685 (+72 ms) 2023-07-19 10:10:32,689 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 10:10:32,692 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 328 msec 2023-07-19 10:10:32,978 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:32,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 10:10:32,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:10:33,001 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:33,006 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:33,007 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35123] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:10:33,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35869] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:10:33,012 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 10:10:33,013 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:33,015 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:10:33,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 10:10:33,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761433042 (current time:1689761433042). 2023-07-19 10:10:33,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:10:33,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x7ecf4f55 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:33,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69f9001f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:33,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:33,056 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:33,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ecf4f55 to 127.0.0.1:56876 2023-07-19 10:10:33,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:33,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x68bd045e to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:33,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c0c5bfb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:33,080 DEBUG [hconnection-0x4dd4579d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:33,083 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:33,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:33,089 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:33,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68bd045e to 127.0.0.1:56876 2023-07-19 10:10:33,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:33,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 10:10:33,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:10:33,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 10:10:33,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 10:10:33,097 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 10:10:33,098 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689762033098 2023-07-19 10:10:33,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 10:10:33,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 10:10:33,100 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:10:33,100 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:10:33,104 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 10:10:33,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 10:10:33,108 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 10 msec 2023-07-19 10:10:33,109 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 10:10:33,110 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689762033110 2023-07-19 10:10:33,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-19 10:10:33,143 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-19 10:10:33,143 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:33,145 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 10:10:33,145 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 10:10:33,146 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,146 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,149 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:33,149 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:33,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:33,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:33,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:33,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:33,150 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,150 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:33,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:33,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:33,152 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,152 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 10:10:33,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 10:10:33,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,153 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 10:10:33,153 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,154 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:10:33,154 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 10:10:33,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 10:10:33,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,154 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 10:10:33,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 10:10:33,156 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 10:10:33,156 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:33,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 10:10:33,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 10:10:33,160 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 10:10:33,167 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 10:10:33,167 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 10:10:33,167 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:33,167 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 10:10:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 10:10:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 10:10:33,168 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 10:10:33,171 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 10:10:33,171 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 10:10:33,171 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 10:10:33,169 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 10:10:33,175 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,175 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:33,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:33,176 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:33,179 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,179 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:33,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:33,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:33,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 10:10:33,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cd8b333[Count = 1] remaining members to acquire global barrier 2023-07-19 10:10:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:33,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 10:10:33,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cd8b333[Count = 0] remaining members to acquire global barrier 2023-07-19 10:10:33,185 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 10:10:33,185 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,193 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,193 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,193 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,194 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 10:10:33,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 10:10:33,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 10:10:33,194 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,194 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:10:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:33,194 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 10:10:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:33,194 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:33,195 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44313,1689761420775' in zk 2023-07-19 10:10:33,194 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. started... 2023-07-19 10:10:33,194 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:33,195 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. started... 2023-07-19 10:10:33,195 INFO [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 739de6c6ca468ebc4e2a8be8a1d682b1 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 10:10:33,195 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 10a97e9627352fc9858789647dd18fe4 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 10:10:33,198 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 10:10:33,198 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:33,198 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 10:10:33,200 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:33,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 10:10:33,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:33,202 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:10:33,334 INFO [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/.tmp/cf/76e7b2863774428dbdca2dd1f90ac4f0 2023-07-19 10:10:33,385 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/.tmp/cf/76e7b2863774428dbdca2dd1f90ac4f0 as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/cf/76e7b2863774428dbdca2dd1f90ac4f0 2023-07-19 10:10:33,394 INFO [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/cf/76e7b2863774428dbdca2dd1f90ac4f0, entries=3, sequenceid=6, filesize=5.0 K 2023-07-19 10:10:33,396 INFO [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 739de6c6ca468ebc4e2a8be8a1d682b1 in 201ms, sequenceid=6, compaction requested=false 2023-07-19 10:10:33,397 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 10:10:33,398 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 739de6c6ca468ebc4e2a8be8a1d682b1: 2023-07-19 10:10:33,398 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 10:10:33,398 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:33,399 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/cf/76e7b2863774428dbdca2dd1f90ac4f0] hfiles 2023-07-19 10:10:33,399 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/cf/76e7b2863774428dbdca2dd1f90ac4f0 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 10:10:33,402 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:33,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 10:10:33,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:33,409 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:10:33,425 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. completed. 2023-07-19 10:10:33,425 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:33,425 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:33,425 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:33,425 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,425 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 10:10:33,425 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35123,1689761420712' in zk 2023-07-19 10:10:33,428 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,428 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 10:10:33,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:33,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:33,428 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:33,429 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 10:10:33,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:33,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:33,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:33,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:33,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35123,1689761420712': 2023-07-19 10:10:33,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 10:10:33,710 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:33,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 10:10:33,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:33,712 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 10:10:33,733 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/.tmp/cf/44120cb91204427f87ebb27fca7d7c73 2023-07-19 10:10:33,743 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/.tmp/cf/44120cb91204427f87ebb27fca7d7c73 as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/cf/44120cb91204427f87ebb27fca7d7c73 2023-07-19 10:10:33,751 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/cf/44120cb91204427f87ebb27fca7d7c73, entries=47, sequenceid=6, filesize=8.0 K 2023-07-19 10:10:33,753 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 10a97e9627352fc9858789647dd18fe4 in 558ms, sequenceid=6, compaction requested=false 2023-07-19 10:10:33,755 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 10a97e9627352fc9858789647dd18fe4: 2023-07-19 10:10:33,755 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 10:10:33,755 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:33,755 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/cf/44120cb91204427f87ebb27fca7d7c73] hfiles 2023-07-19 10:10:33,755 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/cf/44120cb91204427f87ebb27fca7d7c73 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 10:10:33,769 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. completed. 2023-07-19 10:10:33,770 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:33,770 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:33,770 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:33,770 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,770 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 10:10:33,770 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35869,1689761420828' in zk 2023-07-19 10:10:33,773 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,773 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 10:10:33,773 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:33,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:33,773 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 10:10:33,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:33,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:33,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:33,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:33,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:33,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35869,1689761420828': 2023-07-19 10:10:33,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 10:10:33,779 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-19 10:10:33,779 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:10:33,779 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:10:33,779 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-19 10:10:33,779 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:10:33,781 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,781 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,782 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:33,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,782 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:33,782 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:33,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,782 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,782 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,782 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:33,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:33,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:33,783 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,784 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:33,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:33,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:33,786 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:33,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,786 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:33,787 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,816 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:33,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:33,816 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:33,816 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:33,816 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:33,816 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:33,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:33,816 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-19 10:10:33,816 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:33,816 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-19 10:10:33,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:33,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:33,817 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:33,818 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,818 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:33,818 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,818 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,818 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:33,818 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:33,818 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:33,819 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:33,819 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:33,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:33,819 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 10:10:33,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,895 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689761433098Consolidate snapshot: snaptb0-testExportWithTargetName at 1689761433818 (+720 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689761433818Writing data manifest for snaptb0-testExportWithTargetName at 1689761433823 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689761433837 (+14 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689761433894 (+57 ms) 2023-07-19 10:10:33,897 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 10:10:33,900 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 798 msec 2023-07-19 10:10:34,212 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:34,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 10:10:34,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:10:34,216 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761434216 2023-07-19 10:10:34,216 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35157, tgtDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761434216, rawTgtDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761434216, srcFsUri=hdfs://localhost:35157, srcDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:10:34,259 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:10:34,259 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1689334087_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761434216, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761434216/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 10:10:34,259 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc, snapshotDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-19 10:10:34,277 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761434216/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 10:10:34,343 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:34,343 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:34,344 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:34,344 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,394 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-3822070163947989109.jar 2023-07-19 10:10:35,395 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,396 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,480 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-1874474958306857838.jar 2023-07-19 10:10:35,481 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,482 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,483 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,483 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,484 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,485 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,485 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:10:35,486 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:10:35,487 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:10:35,487 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:10:35,488 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:10:35,489 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:10:35,489 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:10:35,490 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:10:35,490 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:10:35,491 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:10:35,497 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:35,497 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:35,498 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:10:35,498 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:35,499 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:35,500 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:10:35,501 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:10:36,732 WARN [Listener at jenkins-hbase4.apache.org/37821] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:10:36,738 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-19 10:10:36,749 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 10:10:37,202 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:10:37,319 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:10:37,320 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:10:37,865 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0001_000001 (auth:SIMPLE) 2023-07-19 10:10:43,026 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0001_000001 (auth:SIMPLE) 2023-07-19 10:10:45,310 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0001_000001 (auth:SIMPLE) 2023-07-19 10:10:48,165 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0001_000001 (auth:SIMPLE) 2023-07-19 10:10:49,695 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:10:49,698 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:10:49,707 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-19 10:10:49,707 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:10:49,708 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:10:49,708 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-818487594_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 10:10:49,709 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-19 10:10:49,709 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-19 10:10:49,709 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-818487594_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761434216/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761434216/.hbase-snapshot/testExportWithTargetName 2023-07-19 10:10:49,709 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761434216/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-19 10:10:49,709 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761434216/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-19 10:10:49,721 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-19 10:10:49,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-19 10:10:49,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:49,742 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761449741"}]},"ts":"1689761449741"} 2023-07-19 10:10:49,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 10:10:49,743 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-19 10:10:49,745 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-19 10:10:49,747 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=739de6c6ca468ebc4e2a8be8a1d682b1, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=10a97e9627352fc9858789647dd18fe4, UNASSIGN}] 2023-07-19 10:10:49,750 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=10a97e9627352fc9858789647dd18fe4, UNASSIGN 2023-07-19 10:10:49,750 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=739de6c6ca468ebc4e2a8be8a1d682b1, UNASSIGN 2023-07-19 10:10:49,751 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=10a97e9627352fc9858789647dd18fe4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:49,751 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=739de6c6ca468ebc4e2a8be8a1d682b1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:49,752 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761449751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761449751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761449751"}]},"ts":"1689761449751"} 2023-07-19 10:10:49,752 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761449751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761449751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761449751"}]},"ts":"1689761449751"} 2023-07-19 10:10:49,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 10a97e9627352fc9858789647dd18fe4, server=jenkins-hbase4.apache.org,35869,1689761420828}] 2023-07-19 10:10:49,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 739de6c6ca468ebc4e2a8be8a1d682b1, server=jenkins-hbase4.apache.org,35123,1689761420712}] 2023-07-19 10:10:49,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 10:10:49,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 10a97e9627352fc9858789647dd18fe4 2023-07-19 10:10:49,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 739de6c6ca468ebc4e2a8be8a1d682b1 2023-07-19 10:10:49,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 10a97e9627352fc9858789647dd18fe4, disabling compactions & flushes 2023-07-19 10:10:49,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 739de6c6ca468ebc4e2a8be8a1d682b1, disabling compactions & flushes 2023-07-19 10:10:49,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:49,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:49,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:49,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:49,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. after waiting 0 ms 2023-07-19 10:10:49,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. after waiting 0 ms 2023-07-19 10:10:49,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:49,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:49,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:10:49,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:10:49,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:10:49,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:10:49,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4. 2023-07-19 10:10:49,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1. 2023-07-19 10:10:49,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 10a97e9627352fc9858789647dd18fe4: 2023-07-19 10:10:49,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 739de6c6ca468ebc4e2a8be8a1d682b1: 2023-07-19 10:10:49,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 739de6c6ca468ebc4e2a8be8a1d682b1 2023-07-19 10:10:49,935 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=739de6c6ca468ebc4e2a8be8a1d682b1, regionState=CLOSED 2023-07-19 10:10:49,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 10a97e9627352fc9858789647dd18fe4 2023-07-19 10:10:49,936 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761449935"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761449935"}]},"ts":"1689761449935"} 2023-07-19 10:10:49,936 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=10a97e9627352fc9858789647dd18fe4, regionState=CLOSED 2023-07-19 10:10:49,936 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761449936"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761449936"}]},"ts":"1689761449936"} 2023-07-19 10:10:49,940 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-19 10:10:49,940 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 739de6c6ca468ebc4e2a8be8a1d682b1, server=jenkins-hbase4.apache.org,35123,1689761420712 in 183 msec 2023-07-19 10:10:49,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-19 10:10:49,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 10a97e9627352fc9858789647dd18fe4, server=jenkins-hbase4.apache.org,35869,1689761420828 in 185 msec 2023-07-19 10:10:49,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=739de6c6ca468ebc4e2a8be8a1d682b1, UNASSIGN in 193 msec 2023-07-19 10:10:49,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-19 10:10:49,944 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=10a97e9627352fc9858789647dd18fe4, UNASSIGN in 194 msec 2023-07-19 10:10:49,945 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761449944"}]},"ts":"1689761449944"} 2023-07-19 10:10:49,946 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-19 10:10:49,948 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-19 10:10:49,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 219 msec 2023-07-19 10:10:50,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 10:10:50,046 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-19 10:10:50,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-19 10:10:50,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:50,061 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:50,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-19 10:10:50,063 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:50,066 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-19 10:10:50,069 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1 2023-07-19 10:10:50,069 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4 2023-07-19 10:10:50,070 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:50,070 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:50,070 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:50,071 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:50,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 10:10:50,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 10:10:50,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 10:10:50,076 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:50,076 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:50,076 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:50,076 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:50,076 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:50,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 10:10:50,076 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 10:10:50,076 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:50,076 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:50,077 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/recovered.edits] 2023-07-19 10:10:50,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 10:10:50,083 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/recovered.edits] 2023-07-19 10:10:50,089 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/cf/44120cb91204427f87ebb27fca7d7c73 to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/cf/44120cb91204427f87ebb27fca7d7c73 2023-07-19 10:10:50,089 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/cf/76e7b2863774428dbdca2dd1f90ac4f0 to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/cf/76e7b2863774428dbdca2dd1f90ac4f0 2023-07-19 10:10:50,093 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/recovered.edits/9.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4/recovered.edits/9.seqid 2023-07-19 10:10:50,094 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/recovered.edits/9.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1/recovered.edits/9.seqid 2023-07-19 10:10:50,094 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/10a97e9627352fc9858789647dd18fe4 2023-07-19 10:10:50,095 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportWithTargetName/739de6c6ca468ebc4e2a8be8a1d682b1 2023-07-19 10:10:50,095 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 10:10:50,098 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:50,121 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-19 10:10:50,125 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-19 10:10:50,127 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:50,127 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-19 10:10:50,127 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761450127"}]},"ts":"9223372036854775807"} 2023-07-19 10:10:50,127 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761450127"}]},"ts":"9223372036854775807"} 2023-07-19 10:10:50,130 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 10:10:50,130 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 739de6c6ca468ebc4e2a8be8a1d682b1, NAME => 'testtb-testExportWithTargetName,,1689761431135.739de6c6ca468ebc4e2a8be8a1d682b1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 10a97e9627352fc9858789647dd18fe4, NAME => 'testtb-testExportWithTargetName,1,1689761431135.10a97e9627352fc9858789647dd18fe4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 10:10:50,130 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-19 10:10:50,130 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761450130"}]},"ts":"9223372036854775807"} 2023-07-19 10:10:50,132 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-19 10:10:50,135 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:50,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 83 msec 2023-07-19 10:10:50,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 10:10:50,182 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-19 10:10:50,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-19 10:10:50,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:50,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-19 10:10:50,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-19 10:10:50,238 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=753 (was 707) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355260126_1 at /127.0.0.1:54396 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818487594_17 at /127.0.0.1:38362 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase4.apache.org/172.31.14.131:44107 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818487594_17 at /127.0.0.1:54420 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818487594_17 at /127.0.0.1:60974 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase4.apache.org/172.31.14.131:33159 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=916 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=430 (was 299) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=3096 (was 4909) 2023-07-19 10:10:50,238 WARN [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-19 10:10:50,258 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=430, ProcessCount=182, AvailableMemoryMB=3095 2023-07-19 10:10:50,258 WARN [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-19 10:10:50,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 10:10:50,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:10:50,264 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:10:50,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-19 10:10:50,265 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:10:50,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 10:10:50,268 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd 2023-07-19 10:10:50,268 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71 2023-07-19 10:10:50,269 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd empty. 2023-07-19 10:10:50,269 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71 empty. 2023-07-19 10:10:50,270 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd 2023-07-19 10:10:50,270 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71 2023-07-19 10:10:50,270 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 10:10:50,288 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 10:10:50,289 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5bc7824e0b6f8bde4e0ba92886733bbd, NAME => 'testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:10:50,290 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c8f233d255e1ff1db896e537b2336b71, NAME => 'testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:10:50,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:50,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c8f233d255e1ff1db896e537b2336b71, disabling compactions & flushes 2023-07-19 10:10:50,315 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:10:50,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:10:50,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. after waiting 0 ms 2023-07-19 10:10:50,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:10:50,315 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:10:50,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c8f233d255e1ff1db896e537b2336b71: 2023-07-19 10:10:50,326 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:50,326 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 5bc7824e0b6f8bde4e0ba92886733bbd, disabling compactions & flushes 2023-07-19 10:10:50,327 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:10:50,327 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:10:50,327 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. after waiting 0 ms 2023-07-19 10:10:50,327 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:10:50,327 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:10:50,327 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 5bc7824e0b6f8bde4e0ba92886733bbd: 2023-07-19 10:10:50,330 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:10:50,331 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761450331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761450331"}]},"ts":"1689761450331"} 2023-07-19 10:10:50,331 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761450331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761450331"}]},"ts":"1689761450331"} 2023-07-19 10:10:50,333 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:10:50,334 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:10:50,335 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761450334"}]},"ts":"1689761450334"} 2023-07-19 10:10:50,336 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 10:10:50,339 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:10:50,340 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:10:50,340 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:10:50,340 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:10:50,340 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:10:50,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5bc7824e0b6f8bde4e0ba92886733bbd, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8f233d255e1ff1db896e537b2336b71, ASSIGN}] 2023-07-19 10:10:50,343 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8f233d255e1ff1db896e537b2336b71, ASSIGN 2023-07-19 10:10:50,343 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5bc7824e0b6f8bde4e0ba92886733bbd, ASSIGN 2023-07-19 10:10:50,344 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8f233d255e1ff1db896e537b2336b71, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35869,1689761420828; forceNewPlan=false, retain=false 2023-07-19 10:10:50,344 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5bc7824e0b6f8bde4e0ba92886733bbd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44313,1689761420775; forceNewPlan=false, retain=false 2023-07-19 10:10:50,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 10:10:50,494 INFO [jenkins-hbase4:40385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:10:50,497 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5bc7824e0b6f8bde4e0ba92886733bbd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:50,497 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c8f233d255e1ff1db896e537b2336b71, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:50,498 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761450497"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761450497"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761450497"}]},"ts":"1689761450497"} 2023-07-19 10:10:50,498 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761450497"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761450497"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761450497"}]},"ts":"1689761450497"} 2023-07-19 10:10:50,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 5bc7824e0b6f8bde4e0ba92886733bbd, server=jenkins-hbase4.apache.org,44313,1689761420775}] 2023-07-19 10:10:50,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure c8f233d255e1ff1db896e537b2336b71, server=jenkins-hbase4.apache.org,35869,1689761420828}] 2023-07-19 10:10:50,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 10:10:50,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:10:50,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:10:50,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5bc7824e0b6f8bde4e0ba92886733bbd, NAME => 'testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 10:10:50,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c8f233d255e1ff1db896e537b2336b71, NAME => 'testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 10:10:50,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. service=AccessControlService 2023-07-19 10:10:50,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:50,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 5bc7824e0b6f8bde4e0ba92886733bbd 2023-07-19 10:10:50,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:50,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5bc7824e0b6f8bde4e0ba92886733bbd 2023-07-19 10:10:50,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. service=AccessControlService 2023-07-19 10:10:50,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5bc7824e0b6f8bde4e0ba92886733bbd 2023-07-19 10:10:50,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:50,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c8f233d255e1ff1db896e537b2336b71 2023-07-19 10:10:50,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:50,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c8f233d255e1ff1db896e537b2336b71 2023-07-19 10:10:50,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c8f233d255e1ff1db896e537b2336b71 2023-07-19 10:10:50,666 INFO [StoreOpener-5bc7824e0b6f8bde4e0ba92886733bbd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5bc7824e0b6f8bde4e0ba92886733bbd 2023-07-19 10:10:50,666 INFO [StoreOpener-c8f233d255e1ff1db896e537b2336b71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c8f233d255e1ff1db896e537b2336b71 2023-07-19 10:10:50,668 DEBUG [StoreOpener-5bc7824e0b6f8bde4e0ba92886733bbd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/cf 2023-07-19 10:10:50,668 DEBUG [StoreOpener-5bc7824e0b6f8bde4e0ba92886733bbd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/cf 2023-07-19 10:10:50,668 INFO [StoreOpener-5bc7824e0b6f8bde4e0ba92886733bbd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5bc7824e0b6f8bde4e0ba92886733bbd columnFamilyName cf 2023-07-19 10:10:50,669 INFO [StoreOpener-5bc7824e0b6f8bde4e0ba92886733bbd-1] regionserver.HStore(310): Store=5bc7824e0b6f8bde4e0ba92886733bbd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:50,669 DEBUG [StoreOpener-c8f233d255e1ff1db896e537b2336b71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/cf 2023-07-19 10:10:50,670 DEBUG [StoreOpener-c8f233d255e1ff1db896e537b2336b71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/cf 2023-07-19 10:10:50,670 INFO [StoreOpener-c8f233d255e1ff1db896e537b2336b71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8f233d255e1ff1db896e537b2336b71 columnFamilyName cf 2023-07-19 10:10:50,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd 2023-07-19 10:10:50,671 INFO [StoreOpener-c8f233d255e1ff1db896e537b2336b71-1] regionserver.HStore(310): Store=c8f233d255e1ff1db896e537b2336b71/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:50,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd 2023-07-19 10:10:50,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71 2023-07-19 10:10:50,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71 2023-07-19 10:10:50,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5bc7824e0b6f8bde4e0ba92886733bbd 2023-07-19 10:10:50,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c8f233d255e1ff1db896e537b2336b71 2023-07-19 10:10:50,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:50,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5bc7824e0b6f8bde4e0ba92886733bbd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73273949, jitterRate=0.09186692535877228}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:50,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5bc7824e0b6f8bde4e0ba92886733bbd: 2023-07-19 10:10:50,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:50,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c8f233d255e1ff1db896e537b2336b71; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61018385, jitterRate=-0.09075520932674408}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:50,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c8f233d255e1ff1db896e537b2336b71: 2023-07-19 10:10:50,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd., pid=30, masterSystemTime=1689761450654 2023-07-19 10:10:50,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71., pid=31, masterSystemTime=1689761450659 2023-07-19 10:10:50,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:10:50,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:10:50,684 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5bc7824e0b6f8bde4e0ba92886733bbd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:50,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:10:50,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:10:50,685 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761450684"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761450684"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761450684"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761450684"}]},"ts":"1689761450684"} 2023-07-19 10:10:50,687 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c8f233d255e1ff1db896e537b2336b71, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:50,687 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761450687"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761450687"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761450687"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761450687"}]},"ts":"1689761450687"} 2023-07-19 10:10:50,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-19 10:10:50,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 5bc7824e0b6f8bde4e0ba92886733bbd, server=jenkins-hbase4.apache.org,44313,1689761420775 in 188 msec 2023-07-19 10:10:50,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-19 10:10:50,696 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure c8f233d255e1ff1db896e537b2336b71, server=jenkins-hbase4.apache.org,35869,1689761420828 in 186 msec 2023-07-19 10:10:50,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5bc7824e0b6f8bde4e0ba92886733bbd, ASSIGN in 352 msec 2023-07-19 10:10:50,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-19 10:10:50,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8f233d255e1ff1db896e537b2336b71, ASSIGN in 353 msec 2023-07-19 10:10:50,699 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:10:50,699 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761450699"}]},"ts":"1689761450699"} 2023-07-19 10:10:50,701 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 10:10:50,704 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:10:50,704 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-19 10:10:50,706 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 10:10:50,708 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:50,708 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:50,708 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:50,708 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:50,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:50,710 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:50,710 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:50,710 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:50,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 448 msec 2023-07-19 10:10:50,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 10:10:50,870 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-19 10:10:50,870 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-19 10:10:50,870 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:10:50,874 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-19 10:10:50,874 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:10:50,874 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-19 10:10:50,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:10:50,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761450878 (current time:1689761450878). 2023-07-19 10:10:50,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:10:50,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x125265c5 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:50,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@753fa44e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:50,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:50,892 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:50,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x125265c5 to 127.0.0.1:56876 2023-07-19 10:10:50,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:50,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x036dfffd to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:50,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@290de18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:50,903 DEBUG [hconnection-0xa8517d0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:50,904 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:50,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:50,913 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:50,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x036dfffd to 127.0.0.1:56876 2023-07-19 10:10:50,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:50,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 10:10:50,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:10:50,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:10:50,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:10:50,920 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:10:50,921 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689762050921 2023-07-19 10:10:50,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:10:50,922 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 10:10:50,923 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:10:50,923 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:10:50,928 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:10:50,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 10:10:50,931 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-19 10:10:50,933 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 10:10:50,935 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689762050935 2023-07-19 10:10:50,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,959 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-19 10:10:50,959 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:50,961 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 10:10:50,961 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 10:10:50,961 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,961 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,963 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:50,963 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:50,963 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:50,963 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:50,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:50,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:50,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:50,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:50,964 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:50,964 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,965 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,965 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:10:50,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 10:10:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 10:10:50,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,966 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 10:10:50,966 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 10:10:50,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,966 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,966 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 10:10:50,966 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:50,966 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,967 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 10:10:50,967 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:50,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 10:10:50,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,967 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 10:10:50,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,969 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 10:10:50,972 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 10:10:50,972 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 10:10:50,972 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 10:10:50,972 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 10:10:50,972 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 10:10:50,972 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:50,972 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 10:10:50,973 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 10:10:50,973 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 10:10:50,974 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 10:10:50,984 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:50,984 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,984 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:50,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:50,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:50,984 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,984 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:50,984 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,984 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:50,984 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,984 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:50,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:50,984 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,985 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:50,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:50,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:50,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:50,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:50,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:50,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 10:10:50,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30e1cc6f[Count = 1] remaining members to acquire global barrier 2023-07-19 10:10:50,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:50,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:50,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:50,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:50,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:50,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:50,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:50,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:50,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:50,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 10:10:50,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30e1cc6f[Count = 0] remaining members to acquire global barrier 2023-07-19 10:10:50,990 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 10:10:50,991 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,992 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,992 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,992 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,992 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:10:50,992 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:50,993 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:50,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,993 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:10:50,993 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:10:50,993 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:10:50,993 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:50,993 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:50,993 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. started... 2023-07-19 10:10:50,993 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 10:10:50,993 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:50,993 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:10:50,993 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:10:50,995 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. started... 2023-07-19 10:10:50,993 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:50,995 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c8f233d255e1ff1db896e537b2336b71: 2023-07-19 10:10:50,997 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5bc7824e0b6f8bde4e0ba92886733bbd: 2023-07-19 10:10:50,993 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35123,1689761420712' in zk 2023-07-19 10:10:50,997 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,997 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:50,997 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:10:50,997 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,997 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:50,997 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:10:51,000 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 10:10:51,000 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,000 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 10:10:51,021 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. completed. 2023-07-19 10:10:51,024 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:51,025 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:10:51,026 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:51,026 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:51,026 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,026 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 10:10:51,026 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35869,1689761420828' in zk 2023-07-19 10:10:51,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:10:51,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:51,027 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:10:51,028 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,028 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 10:10:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,028 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,028 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 10:10:51,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,033 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. completed. 2023-07-19 10:10:51,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,033 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:10:51,033 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:51,033 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:51,033 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,033 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 10:10:51,033 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44313,1689761420775' in zk 2023-07-19 10:10:51,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,036 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,036 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 10:10:51,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,036 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,036 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 10:10:51,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35869,1689761420828': 2023-07-19 10:10:51,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 10:10:51,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44313,1689761420775': 2023-07-19 10:10:51,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 10:10:51,043 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-19 10:10:51,043 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:10:51,043 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:10:51,043 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,043 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:10:51,046 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,046 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,046 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,046 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,046 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,046 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,048 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,048 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,049 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,050 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,051 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,051 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,054 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,055 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,055 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,055 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,055 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,055 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,055 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,055 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,058 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,058 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,058 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,058 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,058 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,058 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,058 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,058 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,058 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,058 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,058 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState because node does not exist (not an error) 2023-07-19 10:10:51,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 10:10:51,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,131 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689761450922Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689761451057 (+135 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689761451057Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689761451062 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689761451092 (+30 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689761451131 (+39 ms) 2023-07-19 10:10:51,136 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 10:10:51,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 213 msec 2023-07-19 10:10:51,227 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:51,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:10:51,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:10:51,238 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:51,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35869] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:10:51,243 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:51,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44313] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:10:51,248 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 10:10:51,248 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:10:51,250 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:10:51,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:10:51,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761451263 (current time:1689761451263). 2023-07-19 10:10:51,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:10:51,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x35a126aa to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:51,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@599cd7c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:51,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:51,280 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:51,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35a126aa to 127.0.0.1:56876 2023-07-19 10:10:51,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:51,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x7ebc5a29 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:51,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d89427e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:51,295 DEBUG [hconnection-0x6f721321-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:51,297 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:51,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:51,305 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:51,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ebc5a29 to 127.0.0.1:56876 2023-07-19 10:10:51,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:51,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 10:10:51,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:10:51,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:10:51,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:10:51,312 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:10:51,313 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689762051313 2023-07-19 10:10:51,313 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 10:10:51,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:10:51,315 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:10:51,315 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:10:51,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 10:10:51,316 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:10:51,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-19 10:10:51,319 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 10:10:51,320 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689762051320 2023-07-19 10:10:51,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-19 10:10:51,339 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-19 10:10:51,339 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:51,340 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 10:10:51,341 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 10:10:51,341 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,341 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,343 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,343 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,343 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,343 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,344 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,344 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,345 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,345 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:10:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 10:10:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 10:10:51,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,346 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 10:10:51,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,346 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 10:10:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 10:10:51,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,346 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 10:10:51,346 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 10:10:51,347 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 10:10:51,347 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:51,347 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 10:10:51,347 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 10:10:51,349 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:51,348 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 10:10:51,350 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 10:10:51,350 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 10:10:51,347 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 10:10:51,350 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 10:10:51,350 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 10:10:51,351 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 10:10:51,351 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:51,351 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 10:10:51,352 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,352 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,353 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,354 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,354 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:51,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,356 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 10:10:51,356 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 10:10:51,356 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,356 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 10:10:51,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,356 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,356 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:51,357 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,358 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,358 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:51,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 10:10:51,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6da0f39e[Count = 1] remaining members to acquire global barrier 2023-07-19 10:10:51,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 10:10:51,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6da0f39e[Count = 0] remaining members to acquire global barrier 2023-07-19 10:10:51,363 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 10:10:51,363 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,366 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,366 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,366 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,366 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:10:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,366 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:10:51,366 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,366 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:51,366 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:51,366 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:10:51,366 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 10:10:51,367 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. started... 2023-07-19 10:10:51,366 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:10:51,367 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,367 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35123,1689761420712' in zk 2023-07-19 10:10:51,367 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5bc7824e0b6f8bde4e0ba92886733bbd 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-19 10:10:51,367 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:10:51,368 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 10:10:51,369 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,369 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 10:10:51,370 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:51,372 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:10:51,372 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:51,372 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. started... 2023-07-19 10:10:51,373 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c8f233d255e1ff1db896e537b2336b71 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-19 10:10:51,399 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/.tmp/cf/39648b5abf0e4ea9b6186bf8c69dc09d 2023-07-19 10:10:51,406 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/.tmp/cf/8df7aa7784444b7983845b880c19360b 2023-07-19 10:10:51,410 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/.tmp/cf/39648b5abf0e4ea9b6186bf8c69dc09d as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/cf/39648b5abf0e4ea9b6186bf8c69dc09d 2023-07-19 10:10:51,415 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:51,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:10:51,417 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/.tmp/cf/8df7aa7784444b7983845b880c19360b as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/cf/8df7aa7784444b7983845b880c19360b 2023-07-19 10:10:51,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:51,419 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:10:51,423 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/cf/39648b5abf0e4ea9b6186bf8c69dc09d, entries=5, sequenceid=6, filesize=5.2 K 2023-07-19 10:10:51,425 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 5bc7824e0b6f8bde4e0ba92886733bbd in 58ms, sequenceid=6, compaction requested=false 2023-07-19 10:10:51,425 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 10:10:51,425 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5bc7824e0b6f8bde4e0ba92886733bbd: 2023-07-19 10:10:51,426 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 10:10:51,426 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:51,426 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/cf/39648b5abf0e4ea9b6186bf8c69dc09d] hfiles 2023-07-19 10:10:51,426 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/cf/39648b5abf0e4ea9b6186bf8c69dc09d for snapshot=snaptb0-testExportFileSystemState 2023-07-19 10:10:51,430 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/cf/8df7aa7784444b7983845b880c19360b, entries=45, sequenceid=6, filesize=7.9 K 2023-07-19 10:10:51,431 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for c8f233d255e1ff1db896e537b2336b71 in 58ms, sequenceid=6, compaction requested=false 2023-07-19 10:10:51,442 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c8f233d255e1ff1db896e537b2336b71: 2023-07-19 10:10:51,443 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 10:10:51,443 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:51,443 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/cf/8df7aa7784444b7983845b880c19360b] hfiles 2023-07-19 10:10:51,443 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/cf/8df7aa7784444b7983845b880c19360b for snapshot=snaptb0-testExportFileSystemState 2023-07-19 10:10:51,454 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. completed. 2023-07-19 10:10:51,454 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:10:51,454 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:51,454 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:51,454 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,455 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 10:10:51,455 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44313,1689761420775' in zk 2023-07-19 10:10:51,461 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 10:10:51,461 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,461 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,461 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 10:10:51,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,467 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. completed. 2023-07-19 10:10:51,467 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:10:51,467 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:51,467 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:51,467 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,467 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 10:10:51,468 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35869,1689761420828' in zk 2023-07-19 10:10:51,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,470 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 10:10:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,470 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,470 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,470 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 10:10:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44313,1689761420775': 2023-07-19 10:10:51,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 10:10:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35869,1689761420828': 2023-07-19 10:10:51,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 10:10:51,477 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-19 10:10:51,477 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:10:51,477 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:10:51,477 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-19 10:10:51,477 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:10:51,479 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,479 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,479 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,479 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,479 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,480 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,479 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,490 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,491 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,493 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,497 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,498 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,499 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,503 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,503 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,503 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,503 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,503 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,503 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,504 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,504 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,504 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-19 10:10:51,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-19 10:10:51,504 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,503 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,504 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,505 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,505 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:10:51,505 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,505 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:10:51,505 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:10:51,505 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,505 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,612 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 10:10:51,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,613 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689761451313Consolidate snapshot: snaptb0-testExportFileSystemState at 1689761451504 (+191 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689761451504Writing data manifest for snaptb0-testExportFileSystemState at 1689761451520 (+16 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689761451550 (+30 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689761451612 (+62 ms) 2023-07-19 10:10:51,616 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 10:10:51,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 302 msec 2023-07-19 10:10:51,620 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:51,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:10:51,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:10:51,623 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761451623 2023-07-19 10:10:51,623 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35157, tgtDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761451623, rawTgtDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761451623, srcFsUri=hdfs://localhost:35157, srcDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:10:51,659 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:10:51,659 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_603106324_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761451623, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761451623/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,659 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc, snapshotDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-19 10:10:51,673 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761451623/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,703 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:51,704 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:51,704 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:51,705 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:52,657 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-8685239216371155311.jar 2023-07-19 10:10:52,657 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:52,658 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:52,727 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-3324504944005835969.jar 2023-07-19 10:10:52,728 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:52,728 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:52,728 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:52,729 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:52,729 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:52,729 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:52,730 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:10:52,730 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:10:52,731 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:10:52,731 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:10:52,731 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:10:52,732 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:10:52,732 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:10:52,733 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:10:52,733 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:10:52,734 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:10:52,734 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:52,735 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:52,735 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:10:52,736 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:52,736 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:52,736 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:10:52,737 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:10:53,242 WARN [Listener at jenkins-hbase4.apache.org/37821] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:10:53,245 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-19 10:10:53,248 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 10:10:54,361 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:10:54,362 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:10:54,368 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0001_000001 (auth:SIMPLE) 2023-07-19 10:10:55,032 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0002_000001 (auth:SIMPLE) 2023-07-19 10:10:55,563 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:11:00,132 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0002_000001 (auth:SIMPLE) 2023-07-19 10:11:02,352 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0002_000001 (auth:SIMPLE) 2023-07-19 10:11:06,328 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0002_000001 (auth:SIMPLE) 2023-07-19 10:11:07,454 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:11:07,457 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:11:07,465 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-19 10:11:07,465 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:11:07,465 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:11:07,466 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-818487594_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 10:11:07,466 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 10:11:07,466 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 10:11:07,466 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-818487594_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761451623/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761451623/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 10:11:07,467 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761451623/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 10:11:07,467 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761451623/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 10:11:07,476 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-19 10:11:07,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-19 10:11:07,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 10:11:07,484 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761467484"}]},"ts":"1689761467484"} 2023-07-19 10:11:07,486 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 10:11:07,488 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-19 10:11:07,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5bc7824e0b6f8bde4e0ba92886733bbd, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8f233d255e1ff1db896e537b2336b71, UNASSIGN}] 2023-07-19 10:11:07,491 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8f233d255e1ff1db896e537b2336b71, UNASSIGN 2023-07-19 10:11:07,491 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5bc7824e0b6f8bde4e0ba92886733bbd, UNASSIGN 2023-07-19 10:11:07,492 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c8f233d255e1ff1db896e537b2336b71, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:07,492 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761467492"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761467492"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761467492"}]},"ts":"1689761467492"} 2023-07-19 10:11:07,492 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5bc7824e0b6f8bde4e0ba92886733bbd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:07,492 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761467492"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761467492"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761467492"}]},"ts":"1689761467492"} 2023-07-19 10:11:07,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure c8f233d255e1ff1db896e537b2336b71, server=jenkins-hbase4.apache.org,35869,1689761420828}] 2023-07-19 10:11:07,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 5bc7824e0b6f8bde4e0ba92886733bbd, server=jenkins-hbase4.apache.org,44313,1689761420775}] 2023-07-19 10:11:07,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 10:11:07,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c8f233d255e1ff1db896e537b2336b71 2023-07-19 10:11:07,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c8f233d255e1ff1db896e537b2336b71, disabling compactions & flushes 2023-07-19 10:11:07,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:11:07,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:11:07,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. after waiting 0 ms 2023-07-19 10:11:07,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:11:07,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5bc7824e0b6f8bde4e0ba92886733bbd 2023-07-19 10:11:07,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5bc7824e0b6f8bde4e0ba92886733bbd, disabling compactions & flushes 2023-07-19 10:11:07,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:11:07,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:11:07,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. after waiting 0 ms 2023-07-19 10:11:07,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:11:07,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:11:07,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:11:07,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:11:07,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:11:07,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71. 2023-07-19 10:11:07,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd. 2023-07-19 10:11:07,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c8f233d255e1ff1db896e537b2336b71: 2023-07-19 10:11:07,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5bc7824e0b6f8bde4e0ba92886733bbd: 2023-07-19 10:11:07,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5bc7824e0b6f8bde4e0ba92886733bbd 2023-07-19 10:11:07,674 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5bc7824e0b6f8bde4e0ba92886733bbd, regionState=CLOSED 2023-07-19 10:11:07,675 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761467674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761467674"}]},"ts":"1689761467674"} 2023-07-19 10:11:07,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c8f233d255e1ff1db896e537b2336b71 2023-07-19 10:11:07,675 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c8f233d255e1ff1db896e537b2336b71, regionState=CLOSED 2023-07-19 10:11:07,675 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761467675"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761467675"}]},"ts":"1689761467675"} 2023-07-19 10:11:07,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-19 10:11:07,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 5bc7824e0b6f8bde4e0ba92886733bbd, server=jenkins-hbase4.apache.org,44313,1689761420775 in 186 msec 2023-07-19 10:11:07,683 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-19 10:11:07,683 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure c8f233d255e1ff1db896e537b2336b71, server=jenkins-hbase4.apache.org,35869,1689761420828 in 187 msec 2023-07-19 10:11:07,684 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5bc7824e0b6f8bde4e0ba92886733bbd, UNASSIGN in 193 msec 2023-07-19 10:11:07,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-19 10:11:07,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c8f233d255e1ff1db896e537b2336b71, UNASSIGN in 194 msec 2023-07-19 10:11:07,687 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761467687"}]},"ts":"1689761467687"} 2023-07-19 10:11:07,688 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 10:11:07,690 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-19 10:11:07,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 215 msec 2023-07-19 10:11:07,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 10:11:07,787 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-19 10:11:07,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-19 10:11:07,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,791 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-19 10:11:07,792 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,796 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-19 10:11:07,798 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd 2023-07-19 10:11:07,798 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71 2023-07-19 10:11:07,800 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,800 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,800 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,800 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 10:11:07,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 10:11:07,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 10:11:07,801 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 10:11:07,802 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/recovered.edits] 2023-07-19 10:11:07,802 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/recovered.edits] 2023-07-19 10:11:07,802 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,802 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,802 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,802 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:07,802 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:07,802 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,802 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:07,802 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:07,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 10:11:07,811 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/cf/8df7aa7784444b7983845b880c19360b to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/cf/8df7aa7784444b7983845b880c19360b 2023-07-19 10:11:07,812 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/cf/39648b5abf0e4ea9b6186bf8c69dc09d to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/cf/39648b5abf0e4ea9b6186bf8c69dc09d 2023-07-19 10:11:07,815 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/recovered.edits/9.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71/recovered.edits/9.seqid 2023-07-19 10:11:07,816 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/c8f233d255e1ff1db896e537b2336b71 2023-07-19 10:11:07,816 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/recovered.edits/9.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd/recovered.edits/9.seqid 2023-07-19 10:11:07,817 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemState/5bc7824e0b6f8bde4e0ba92886733bbd 2023-07-19 10:11:07,817 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 10:11:07,822 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,824 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-19 10:11:07,827 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-19 10:11:07,828 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,828 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-19 10:11:07,828 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761467828"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:07,828 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761467828"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:07,830 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 10:11:07,830 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5bc7824e0b6f8bde4e0ba92886733bbd, NAME => 'testtb-testExportFileSystemState,,1689761450260.5bc7824e0b6f8bde4e0ba92886733bbd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c8f233d255e1ff1db896e537b2336b71, NAME => 'testtb-testExportFileSystemState,1,1689761450260.c8f233d255e1ff1db896e537b2336b71.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 10:11:07,830 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-19 10:11:07,830 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761467830"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:07,832 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-19 10:11:07,834 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,836 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 46 msec 2023-07-19 10:11:07,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 10:11:07,905 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-19 10:11:07,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-19 10:11:07,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-19 10:11:07,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-19 10:11:07,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-19 10:11:07,945 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=764 (was 753) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase4.apache.org/172.31.14.131:36241 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818487594_17 at /127.0.0.1:33216 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818487594_17 at /127.0.0.1:51832 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1948 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase4.apache.org/172.31.14.131:44431 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818487594_17 at /127.0.0.1:42934 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_538905807_1 at /127.0.0.1:33190 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=533 (was 430) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=2847 (was 3095) 2023-07-19 10:11:07,945 WARN [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-19 10:11:07,965 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=764, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=533, ProcessCount=182, AvailableMemoryMB=2846 2023-07-19 10:11:07,965 WARN [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-19 10:11:07,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 10:11:07,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:07,970 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:11:07,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-19 10:11:07,971 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:11:07,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 10:11:07,974 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd 2023-07-19 10:11:07,974 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5 2023-07-19 10:11:07,974 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd empty. 2023-07-19 10:11:07,975 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5 empty. 2023-07-19 10:11:07,975 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd 2023-07-19 10:11:07,975 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5 2023-07-19 10:11:07,975 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 10:11:07,996 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-19 10:11:07,998 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => a0a01e4fbb50befea1d6e7989eb808a5, NAME => 'testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:11:07,998 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 114eda8db0481fa4dfd25b7032ee7ebd, NAME => 'testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:11:08,023 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:08,023 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing a0a01e4fbb50befea1d6e7989eb808a5, disabling compactions & flushes 2023-07-19 10:11:08,023 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:08,023 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:08,023 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. after waiting 0 ms 2023-07-19 10:11:08,023 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:08,023 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:08,023 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for a0a01e4fbb50befea1d6e7989eb808a5: 2023-07-19 10:11:08,027 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:08,027 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 114eda8db0481fa4dfd25b7032ee7ebd, disabling compactions & flushes 2023-07-19 10:11:08,027 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:08,027 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:08,027 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. after waiting 0 ms 2023-07-19 10:11:08,027 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:08,028 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:08,028 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 114eda8db0481fa4dfd25b7032ee7ebd: 2023-07-19 10:11:08,030 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:11:08,031 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761468031"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761468031"}]},"ts":"1689761468031"} 2023-07-19 10:11:08,032 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761468031"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761468031"}]},"ts":"1689761468031"} 2023-07-19 10:11:08,034 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:11:08,035 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:11:08,036 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761468035"}]},"ts":"1689761468035"} 2023-07-19 10:11:08,037 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-19 10:11:08,042 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:11:08,043 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:11:08,043 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:11:08,043 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:11:08,043 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:11:08,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=114eda8db0481fa4dfd25b7032ee7ebd, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0a01e4fbb50befea1d6e7989eb808a5, ASSIGN}] 2023-07-19 10:11:08,047 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0a01e4fbb50befea1d6e7989eb808a5, ASSIGN 2023-07-19 10:11:08,047 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=114eda8db0481fa4dfd25b7032ee7ebd, ASSIGN 2023-07-19 10:11:08,048 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0a01e4fbb50befea1d6e7989eb808a5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35869,1689761420828; forceNewPlan=false, retain=false 2023-07-19 10:11:08,048 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=114eda8db0481fa4dfd25b7032ee7ebd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44313,1689761420775; forceNewPlan=false, retain=false 2023-07-19 10:11:08,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 10:11:08,198 INFO [jenkins-hbase4:40385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:11:08,201 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=114eda8db0481fa4dfd25b7032ee7ebd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,201 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a0a01e4fbb50befea1d6e7989eb808a5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,201 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761468201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761468201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761468201"}]},"ts":"1689761468201"} 2023-07-19 10:11:08,201 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761468201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761468201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761468201"}]},"ts":"1689761468201"} 2023-07-19 10:11:08,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 114eda8db0481fa4dfd25b7032ee7ebd, server=jenkins-hbase4.apache.org,44313,1689761420775}] 2023-07-19 10:11:08,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure a0a01e4fbb50befea1d6e7989eb808a5, server=jenkins-hbase4.apache.org,35869,1689761420828}] 2023-07-19 10:11:08,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 10:11:08,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:08,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 114eda8db0481fa4dfd25b7032ee7ebd, NAME => 'testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 10:11:08,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:08,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. service=AccessControlService 2023-07-19 10:11:08,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a0a01e4fbb50befea1d6e7989eb808a5, NAME => 'testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 10:11:08,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:08,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. service=AccessControlService 2023-07-19 10:11:08,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 114eda8db0481fa4dfd25b7032ee7ebd 2023-07-19 10:11:08,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:08,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:08,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 114eda8db0481fa4dfd25b7032ee7ebd 2023-07-19 10:11:08,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 114eda8db0481fa4dfd25b7032ee7ebd 2023-07-19 10:11:08,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a0a01e4fbb50befea1d6e7989eb808a5 2023-07-19 10:11:08,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:08,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a0a01e4fbb50befea1d6e7989eb808a5 2023-07-19 10:11:08,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a0a01e4fbb50befea1d6e7989eb808a5 2023-07-19 10:11:08,361 INFO [StoreOpener-114eda8db0481fa4dfd25b7032ee7ebd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 114eda8db0481fa4dfd25b7032ee7ebd 2023-07-19 10:11:08,361 INFO [StoreOpener-a0a01e4fbb50befea1d6e7989eb808a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a0a01e4fbb50befea1d6e7989eb808a5 2023-07-19 10:11:08,362 DEBUG [StoreOpener-114eda8db0481fa4dfd25b7032ee7ebd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/cf 2023-07-19 10:11:08,362 DEBUG [StoreOpener-114eda8db0481fa4dfd25b7032ee7ebd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/cf 2023-07-19 10:11:08,362 DEBUG [StoreOpener-a0a01e4fbb50befea1d6e7989eb808a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/cf 2023-07-19 10:11:08,362 DEBUG [StoreOpener-a0a01e4fbb50befea1d6e7989eb808a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/cf 2023-07-19 10:11:08,363 INFO [StoreOpener-114eda8db0481fa4dfd25b7032ee7ebd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 114eda8db0481fa4dfd25b7032ee7ebd columnFamilyName cf 2023-07-19 10:11:08,363 INFO [StoreOpener-a0a01e4fbb50befea1d6e7989eb808a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0a01e4fbb50befea1d6e7989eb808a5 columnFamilyName cf 2023-07-19 10:11:08,363 INFO [StoreOpener-114eda8db0481fa4dfd25b7032ee7ebd-1] regionserver.HStore(310): Store=114eda8db0481fa4dfd25b7032ee7ebd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:08,363 INFO [StoreOpener-a0a01e4fbb50befea1d6e7989eb808a5-1] regionserver.HStore(310): Store=a0a01e4fbb50befea1d6e7989eb808a5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:08,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd 2023-07-19 10:11:08,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5 2023-07-19 10:11:08,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd 2023-07-19 10:11:08,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5 2023-07-19 10:11:08,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 114eda8db0481fa4dfd25b7032ee7ebd 2023-07-19 10:11:08,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a0a01e4fbb50befea1d6e7989eb808a5 2023-07-19 10:11:08,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:11:08,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:11:08,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 114eda8db0481fa4dfd25b7032ee7ebd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68846198, jitterRate=0.025888293981552124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:08,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a0a01e4fbb50befea1d6e7989eb808a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67812029, jitterRate=0.010477975010871887}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 114eda8db0481fa4dfd25b7032ee7ebd: 2023-07-19 10:11:08,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a0a01e4fbb50befea1d6e7989eb808a5: 2023-07-19 10:11:08,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5., pid=46, masterSystemTime=1689761468356 2023-07-19 10:11:08,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd., pid=45, masterSystemTime=1689761468355 2023-07-19 10:11:08,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:08,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:08,374 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a0a01e4fbb50befea1d6e7989eb808a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,374 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761468374"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761468374"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761468374"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761468374"}]},"ts":"1689761468374"} 2023-07-19 10:11:08,375 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=114eda8db0481fa4dfd25b7032ee7ebd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,375 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761468375"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761468375"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761468375"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761468375"}]},"ts":"1689761468375"} 2023-07-19 10:11:08,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:08,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:08,378 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-19 10:11:08,378 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure a0a01e4fbb50befea1d6e7989eb808a5, server=jenkins-hbase4.apache.org,35869,1689761420828 in 172 msec 2023-07-19 10:11:08,380 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-19 10:11:08,380 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 114eda8db0481fa4dfd25b7032ee7ebd, server=jenkins-hbase4.apache.org,44313,1689761420775 in 174 msec 2023-07-19 10:11:08,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0a01e4fbb50befea1d6e7989eb808a5, ASSIGN in 334 msec 2023-07-19 10:11:08,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-19 10:11:08,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=114eda8db0481fa4dfd25b7032ee7ebd, ASSIGN in 336 msec 2023-07-19 10:11:08,383 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:11:08,383 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761468383"}]},"ts":"1689761468383"} 2023-07-19 10:11:08,385 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-19 10:11:08,387 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:11:08,388 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-19 10:11:08,390 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 10:11:08,391 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:08,391 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:08,391 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:08,391 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:08,394 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:08,394 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:08,394 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:08,394 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:08,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 427 msec 2023-07-19 10:11:08,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 10:11:08,576 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-19 10:11:08,576 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-19 10:11:08,576 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:11:08,583 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-19 10:11:08,583 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:11:08,583 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-19 10:11:08,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 10:11:08,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761468588 (current time:1689761468588). 2023-07-19 10:11:08,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:11:08,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x75635396 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:08,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7429d853, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:08,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:08,602 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:08,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75635396 to 127.0.0.1:56876 2023-07-19 10:11:08,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:08,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x61c22aff to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:08,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e522ab2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:08,619 DEBUG [hconnection-0x3403906b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:08,623 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:08,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:08,630 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:08,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61c22aff to 127.0.0.1:56876 2023-07-19 10:11:08,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:08,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 10:11:08,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:11:08,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 10:11:08,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 10:11:08,636 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 10:11:08,637 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689762068637 2023-07-19 10:11:08,637 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 10:11:08,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 10:11:08,639 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:11:08,639 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:11:08,640 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 10:11:08,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 10:11:08,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-19 10:11:08,642 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 10:11:08,642 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689762068642 2023-07-19 10:11:08,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,657 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-19 10:11:08,657 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:08,658 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 10:11:08,658 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 10:11:08,659 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,659 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,660 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:08,660 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:08,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:08,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:08,660 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:08,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:08,661 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:08,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:08,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:08,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,661 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,661 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,661 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,661 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:11:08,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 10:11:08,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 10:11:08,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 10:11:08,662 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 10:11:08,662 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 10:11:08,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,663 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 10:11:08,663 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 10:11:08,663 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 10:11:08,663 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:08,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,663 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:08,664 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 10:11:08,664 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 10:11:08,665 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:08,665 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 10:11:08,670 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 10:11:08,670 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 10:11:08,665 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 10:11:08,670 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 10:11:08,670 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 10:11:08,670 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 10:11:08,670 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 10:11:08,672 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,672 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,672 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:08,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:08,672 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,672 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,673 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,673 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:08,673 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,673 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:08,673 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,673 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:08,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:08,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:08,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:08,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 10:11:08,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@529bebc4[Count = 1] remaining members to acquire global barrier 2023-07-19 10:11:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:08,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:08,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:08,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:08,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:08,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 10:11:08,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@529bebc4[Count = 0] remaining members to acquire global barrier 2023-07-19 10:11:08,679 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 10:11:08,679 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,681 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,681 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,682 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 10:11:08,681 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,682 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,682 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 10:11:08,682 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 10:11:08,682 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35123,1689761420712' in zk 2023-07-19 10:11:08,682 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,682 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:11:08,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,682 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:08,682 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:08,683 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:08,682 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 10:11:08,683 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. started... 2023-07-19 10:11:08,683 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:08,683 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:08,683 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:08,684 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. started... 2023-07-19 10:11:08,684 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 114eda8db0481fa4dfd25b7032ee7ebd: 2023-07-19 10:11:08,685 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0a01e4fbb50befea1d6e7989eb808a5: 2023-07-19 10:11:08,686 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,686 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,686 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:08,686 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:08,686 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:11:08,686 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:11:08,692 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 10:11:08,692 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:08,692 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 10:11:08,715 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. completed. 2023-07-19 10:11:08,716 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:08,716 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:08,716 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:08,716 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,716 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 10:11:08,716 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35869,1689761420828' in zk 2023-07-19 10:11:08,717 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 10:11:08,717 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,717 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:08,718 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 10:11:08,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:08,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:08,719 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. completed. 2023-07-19 10:11:08,719 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:08,719 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:08,719 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:08,719 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,719 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 10:11:08,719 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44313,1689761420775' in zk 2023-07-19 10:11:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:08,721 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,721 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 10:11:08,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,721 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:08,721 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 10:11:08,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:08,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:08,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35869,1689761420828': 2023-07-19 10:11:08,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 10:11:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:08,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:08,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44313,1689761420775': 2023-07-19 10:11:08,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 10:11:08,728 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-19 10:11:08,728 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:11:08,728 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:11:08,728 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,728 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:11:08,731 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,731 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:08,731 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:08,731 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,731 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:08,731 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:08,731 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:08,731 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,732 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:08,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,732 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:08,734 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,734 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:08,735 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,737 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,737 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,737 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,737 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:08,737 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:08,737 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:08,737 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:08,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:08,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:08,738 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,738 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:08,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,738 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:08,738 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:08,738 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:08,738 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,738 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:08,738 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:08,738 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:08,738 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:08,739 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:08,738 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:08,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:08,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:08,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:08,740 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:08,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:08,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:08,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 10:11:08,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:08,741 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:11:08,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,775 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 10:11:08,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,776 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689761468637Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689761468738 (+101 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689761468738Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689761468743 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689761468751 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689761468775 (+24 ms) 2023-07-19 10:11:08,778 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 10:11:08,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 140 msec 2023-07-19 10:11:08,941 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:08,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 10:11:08,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:11:08,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44313] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:11:08,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35869] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:11:08,954 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 10:11:08,954 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:08,954 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:11:08,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 10:11:08,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761468966 (current time:1689761468966). 2023-07-19 10:11:08,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:11:08,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x78dba978 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:08,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53ea9dc0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:08,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:08,983 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:08,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78dba978 to 127.0.0.1:56876 2023-07-19 10:11:08,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:08,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x394c033a to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:08,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c79ed02, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:08,995 DEBUG [hconnection-0x1bfa77d0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:08,996 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:08,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:09,000 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:09,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x394c033a to 127.0.0.1:56876 2023-07-19 10:11:09,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:09,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 10:11:09,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:11:09,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 10:11:09,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 10:11:09,005 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 10:11:09,006 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689762069006 2023-07-19 10:11:09,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 10:11:09,006 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 10:11:09,007 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:11:09,007 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:11:09,010 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 10:11:09,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 10:11:09,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-19 10:11:09,012 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 10:11:09,013 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689762069013 2023-07-19 10:11:09,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-19 10:11:09,027 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-19 10:11:09,027 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:09,028 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 10:11:09,028 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 10:11:09,029 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,029 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,031 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:09,031 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:09,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:09,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:09,031 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,031 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:09,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,032 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,032 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,032 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,032 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:11:09,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 10:11:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 10:11:09,033 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 10:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 10:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,033 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 10:11:09,033 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 10:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 10:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 10:11:09,033 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 10:11:09,033 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:09,033 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 10:11:09,034 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 10:11:09,034 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 10:11:09,034 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 10:11:09,035 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 10:11:09,035 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 10:11:09,035 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:09,034 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 10:11:09,036 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 10:11:09,036 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 10:11:09,035 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 10:11:09,036 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 10:11:09,036 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 10:11:09,037 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,038 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:09,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:09,038 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,038 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,038 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,038 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:09,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:09,039 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,039 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,040 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:09,041 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,041 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:09,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 10:11:09,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b539b8f[Count = 1] remaining members to acquire global barrier 2023-07-19 10:11:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:09,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:09,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:09,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 10:11:09,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b539b8f[Count = 0] remaining members to acquire global barrier 2023-07-19 10:11:09,043 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 10:11:09,043 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,044 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,044 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,044 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,045 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 10:11:09,045 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,045 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 10:11:09,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,045 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35123,1689761420712' in zk 2023-07-19 10:11:09,045 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 10:11:09,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,045 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 10:11:09,045 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:09,045 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:09,045 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:09,045 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,045 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:09,045 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. started... 2023-07-19 10:11:09,045 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:09,046 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:09,045 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. started... 2023-07-19 10:11:09,045 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:11:09,046 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a0a01e4fbb50befea1d6e7989eb808a5 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 10:11:09,046 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 114eda8db0481fa4dfd25b7032ee7ebd 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 10:11:09,048 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 10:11:09,048 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:09,048 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 10:11:09,063 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/.tmp/cf/2b801defb5604a6b94b4d82e803955cc 2023-07-19 10:11:09,070 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/.tmp/cf/241e8ee58d044291a968d926aaaef377 2023-07-19 10:11:09,071 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/.tmp/cf/2b801defb5604a6b94b4d82e803955cc as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/cf/2b801defb5604a6b94b4d82e803955cc 2023-07-19 10:11:09,076 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/.tmp/cf/241e8ee58d044291a968d926aaaef377 as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/cf/241e8ee58d044291a968d926aaaef377 2023-07-19 10:11:09,077 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/cf/2b801defb5604a6b94b4d82e803955cc, entries=4, sequenceid=6, filesize=5.1 K 2023-07-19 10:11:09,078 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 114eda8db0481fa4dfd25b7032ee7ebd in 32ms, sequenceid=6, compaction requested=false 2023-07-19 10:11:09,078 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 10:11:09,079 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 114eda8db0481fa4dfd25b7032ee7ebd: 2023-07-19 10:11:09,079 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 10:11:09,079 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:09,079 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/cf/2b801defb5604a6b94b4d82e803955cc] hfiles 2023-07-19 10:11:09,079 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/cf/2b801defb5604a6b94b4d82e803955cc for snapshot=snaptb0-testConsecutiveExports 2023-07-19 10:11:09,082 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/cf/241e8ee58d044291a968d926aaaef377, entries=46, sequenceid=6, filesize=7.9 K 2023-07-19 10:11:09,083 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a0a01e4fbb50befea1d6e7989eb808a5 in 37ms, sequenceid=6, compaction requested=false 2023-07-19 10:11:09,085 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0a01e4fbb50befea1d6e7989eb808a5: 2023-07-19 10:11:09,085 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 10:11:09,085 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:09,085 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/cf/241e8ee58d044291a968d926aaaef377] hfiles 2023-07-19 10:11:09,085 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/cf/241e8ee58d044291a968d926aaaef377 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 10:11:09,107 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:09,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 10:11:09,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:09,109 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:11:09,309 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:09,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 10:11:09,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:09,310 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:11:09,504 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. completed. 2023-07-19 10:11:09,504 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. completed. 2023-07-19 10:11:09,504 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:09,504 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:09,504 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:09,504 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 10:11:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 10:11:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44313,1689761420775' in zk 2023-07-19 10:11:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35869,1689761420828' in zk 2023-07-19 10:11:09,507 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,507 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 10:11:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:09,507 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:09,507 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 10:11:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:09,510 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,510 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 10:11:09,511 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:09,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:09,511 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 10:11:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:09,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:09,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44313,1689761420775': 2023-07-19 10:11:09,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 10:11:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:09,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35869,1689761420828': 2023-07-19 10:11:09,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 10:11:09,518 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-19 10:11:09,519 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:11:09,519 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:11:09,519 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-19 10:11:09,519 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:11:09,521 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,521 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:09,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,521 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,522 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,522 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:09,522 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:09,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,522 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:09,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:09,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:09,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:09,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:09,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:09,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:09,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:09,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:09,523 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,524 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:09,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:09,524 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:09,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:09,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,527 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:09,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:09,527 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,528 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,534 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:09,534 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:09,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:09,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:09,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:09,534 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:09,534 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:09,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:09,534 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-19 10:11:09,534 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-19 10:11:09,534 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,534 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:09,534 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:09,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:09,534 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:09,534 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:09,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:09,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:09,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:09,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:09,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:09,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,534 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,538 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,538 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:09,538 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,538 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:09,538 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:09,538 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,538 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:09,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:09,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,587 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 10:11:09,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,588 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689761469006Consolidate snapshot: snaptb0-testConsecutiveExports at 1689761469534 (+528 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689761469534Writing data manifest for snaptb0-testConsecutiveExports at 1689761469542 (+8 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689761469555 (+13 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689761469587 (+32 ms) 2023-07-19 10:11:09,591 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 10:11:09,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 584 msec 2023-07-19 10:11:09,610 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:09,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 10:11:09,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:11:09,612 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612 2023-07-19 10:11:09,612 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612, srcFsUri=hdfs://localhost:35157, srcDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:11:09,635 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:11:09,635 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5d8bf86f, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,635 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc, snapshotDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 10:11:09,643 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,656 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:09,657 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:09,657 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:09,658 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,562 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-3224522125892589059.jar 2023-07-19 10:11:10,562 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,562 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,638 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-1393154331687277224.jar 2023-07-19 10:11:10,638 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,638 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,639 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,639 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,640 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,640 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,640 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:11:10,641 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:11:10,641 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:11:10,641 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:11:10,642 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:11:10,642 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:11:10,643 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:11:10,644 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:11:10,645 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:11:10,645 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:11:10,646 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:10,646 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:10,647 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:10,647 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:10,647 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:10,648 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:10,648 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:11,177 WARN [Listener at jenkins-hbase4.apache.org/37821] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:11:11,180 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 10:11:11,188 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 10:11:12,507 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:11:12,508 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:11:12,511 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0002_000001 (auth:SIMPLE) 2023-07-19 10:11:13,255 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:11:13,308 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0003_000001 (auth:SIMPLE) 2023-07-19 10:11:18,056 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0003_000001 (auth:SIMPLE) 2023-07-19 10:11:20,316 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0003_000001 (auth:SIMPLE) 2023-07-19 10:11:22,869 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0003_000001 (auth:SIMPLE) 2023-07-19 10:11:24,411 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:11:24,411 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:11:24,415 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 10:11:24,415 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:11:24,416 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:11:24,416 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-818487594_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 10:11:24,416 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 10:11:24,416 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 10:11:24,416 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@7c1ce886 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 10:11:24,417 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 10:11:24,417 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 10:11:24,418 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612, srcFsUri=hdfs://localhost:35157, srcDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:11:24,440 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:11:24,440 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2966ff6c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:24,440 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc, snapshotDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 10:11:24,471 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:24,499 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:24,499 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:24,499 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:24,500 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:25,464 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-4904922451737503409.jar 2023-07-19 10:11:25,465 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:25,465 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:25,533 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-5709498115905561989.jar 2023-07-19 10:11:25,534 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:25,534 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:25,535 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:25,536 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:25,536 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:25,537 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:25,537 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:11:25,538 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:11:25,538 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:11:25,538 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:11:25,539 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:11:25,539 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:11:25,540 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:11:25,540 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:11:25,540 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:11:25,541 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:11:25,541 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:25,542 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:25,542 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:25,543 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:25,543 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:25,543 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:25,544 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:25,939 WARN [Listener at jenkins-hbase4.apache.org/37821] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:11:25,942 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 10:11:25,944 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 10:11:29,045 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:11:29,045 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:11:29,049 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0003_000001 (auth:SIMPLE) 2023-07-19 10:11:29,523 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0004_000001 (auth:SIMPLE) 2023-07-19 10:11:34,288 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0004_000001 (auth:SIMPLE) 2023-07-19 10:11:36,554 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0004_000001 (auth:SIMPLE) 2023-07-19 10:11:39,864 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0004_000001 (auth:SIMPLE) 2023-07-19 10:11:41,141 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:11:41,141 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:11:41,145 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 10:11:41,145 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:11:41,145 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:11:41,145 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-818487594_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 10:11:41,150 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 10:11:41,150 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 10:11:41,150 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@7c1ce886 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 10:11:41,151 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 10:11:41,151 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/local-export-1689761469612/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 10:11:41,167 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-19 10:11:41,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-19 10:11:41,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 10:11:41,173 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761501173"}]},"ts":"1689761501173"} 2023-07-19 10:11:41,175 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-19 10:11:41,177 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-19 10:11:41,178 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=114eda8db0481fa4dfd25b7032ee7ebd, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0a01e4fbb50befea1d6e7989eb808a5, UNASSIGN}] 2023-07-19 10:11:41,179 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0a01e4fbb50befea1d6e7989eb808a5, UNASSIGN 2023-07-19 10:11:41,181 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=114eda8db0481fa4dfd25b7032ee7ebd, UNASSIGN 2023-07-19 10:11:41,181 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a0a01e4fbb50befea1d6e7989eb808a5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:41,182 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761501181"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761501181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761501181"}]},"ts":"1689761501181"} 2023-07-19 10:11:41,182 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=114eda8db0481fa4dfd25b7032ee7ebd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:41,182 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761501182"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761501182"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761501182"}]},"ts":"1689761501182"} 2023-07-19 10:11:41,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure a0a01e4fbb50befea1d6e7989eb808a5, server=jenkins-hbase4.apache.org,35869,1689761420828}] 2023-07-19 10:11:41,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 114eda8db0481fa4dfd25b7032ee7ebd, server=jenkins-hbase4.apache.org,44313,1689761420775}] 2023-07-19 10:11:41,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 10:11:41,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a0a01e4fbb50befea1d6e7989eb808a5 2023-07-19 10:11:41,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a0a01e4fbb50befea1d6e7989eb808a5, disabling compactions & flushes 2023-07-19 10:11:41,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:41,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:41,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. after waiting 0 ms 2023-07-19 10:11:41,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:41,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 114eda8db0481fa4dfd25b7032ee7ebd 2023-07-19 10:11:41,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 114eda8db0481fa4dfd25b7032ee7ebd, disabling compactions & flushes 2023-07-19 10:11:41,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:41,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:41,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. after waiting 0 ms 2023-07-19 10:11:41,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:41,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:11:41,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:11:41,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd. 2023-07-19 10:11:41,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 114eda8db0481fa4dfd25b7032ee7ebd: 2023-07-19 10:11:41,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 114eda8db0481fa4dfd25b7032ee7ebd 2023-07-19 10:11:41,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:11:41,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:11:41,376 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=114eda8db0481fa4dfd25b7032ee7ebd, regionState=CLOSED 2023-07-19 10:11:41,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5. 2023-07-19 10:11:41,378 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761501376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761501376"}]},"ts":"1689761501376"} 2023-07-19 10:11:41,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a0a01e4fbb50befea1d6e7989eb808a5: 2023-07-19 10:11:41,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a0a01e4fbb50befea1d6e7989eb808a5 2023-07-19 10:11:41,383 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a0a01e4fbb50befea1d6e7989eb808a5, regionState=CLOSED 2023-07-19 10:11:41,383 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761501383"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761501383"}]},"ts":"1689761501383"} 2023-07-19 10:11:41,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-19 10:11:41,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 114eda8db0481fa4dfd25b7032ee7ebd, server=jenkins-hbase4.apache.org,44313,1689761420775 in 196 msec 2023-07-19 10:11:41,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=114eda8db0481fa4dfd25b7032ee7ebd, UNASSIGN in 208 msec 2023-07-19 10:11:41,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-19 10:11:41,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure a0a01e4fbb50befea1d6e7989eb808a5, server=jenkins-hbase4.apache.org,35869,1689761420828 in 204 msec 2023-07-19 10:11:41,407 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-19 10:11:41,407 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0a01e4fbb50befea1d6e7989eb808a5, UNASSIGN in 219 msec 2023-07-19 10:11:41,408 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761501408"}]},"ts":"1689761501408"} 2023-07-19 10:11:41,409 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-19 10:11:41,412 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-19 10:11:41,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 246 msec 2023-07-19 10:11:41,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 10:11:41,475 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-19 10:11:41,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-19 10:11:41,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,480 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-19 10:11:41,482 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,489 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-19 10:11:41,493 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,493 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,493 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,493 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 10:11:41,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 10:11:41,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 10:11:41,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 10:11:41,494 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd 2023-07-19 10:11:41,495 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,495 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,495 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,495 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5 2023-07-19 10:11:41,495 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:41,495 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:41,495 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:41,495 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,495 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:41,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 10:11:41,499 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/recovered.edits] 2023-07-19 10:11:41,502 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/recovered.edits] 2023-07-19 10:11:41,504 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/cf/2b801defb5604a6b94b4d82e803955cc to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/cf/2b801defb5604a6b94b4d82e803955cc 2023-07-19 10:11:41,506 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/cf/241e8ee58d044291a968d926aaaef377 to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/cf/241e8ee58d044291a968d926aaaef377 2023-07-19 10:11:41,507 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/recovered.edits/9.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd/recovered.edits/9.seqid 2023-07-19 10:11:41,508 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/114eda8db0481fa4dfd25b7032ee7ebd 2023-07-19 10:11:41,510 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/recovered.edits/9.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5/recovered.edits/9.seqid 2023-07-19 10:11:41,511 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testConsecutiveExports/a0a01e4fbb50befea1d6e7989eb808a5 2023-07-19 10:11:41,511 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 10:11:41,513 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,516 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-19 10:11:41,518 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-19 10:11:41,527 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,527 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-19 10:11:41,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761501527"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:41,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761501527"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:41,529 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 10:11:41,529 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 114eda8db0481fa4dfd25b7032ee7ebd, NAME => 'testtb-testConsecutiveExports,,1689761467966.114eda8db0481fa4dfd25b7032ee7ebd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a0a01e4fbb50befea1d6e7989eb808a5, NAME => 'testtb-testConsecutiveExports,1,1689761467966.a0a01e4fbb50befea1d6e7989eb808a5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 10:11:41,530 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-19 10:11:41,530 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761501530"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:41,532 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-19 10:11:41,534 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 57 msec 2023-07-19 10:11:41,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 10:11:41,597 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-19 10:11:41,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-19 10:11:41,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:41,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-19 10:11:41,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-19 10:11:41,657 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=748 (was 764), OpenFileDescriptor=891 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=497 (was 533), ProcessCount=184 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=3030 (was 2846) - AvailableMemoryMB LEAK? - 2023-07-19 10:11:41,657 WARN [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-19 10:11:41,679 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=891, MaxFileDescriptor=60000, SystemLoadAverage=497, ProcessCount=184, AvailableMemoryMB=3028 2023-07-19 10:11:41,679 WARN [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-19 10:11:41,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 10:11:41,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:41,685 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:11:41,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-19 10:11:41,686 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:11:41,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 10:11:41,690 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0 2023-07-19 10:11:41,690 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2 2023-07-19 10:11:41,690 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2 empty. 2023-07-19 10:11:41,691 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0 empty. 2023-07-19 10:11:41,691 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2 2023-07-19 10:11:41,691 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0 2023-07-19 10:11:41,691 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 10:11:41,728 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-19 10:11:41,730 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => b5c7c60d1b53f5c030c3700c00c30fd2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:11:41,730 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5948d96e3c0501914c38fa363f0271a0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:11:41,788 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:41,788 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing b5c7c60d1b53f5c030c3700c00c30fd2, disabling compactions & flushes 2023-07-19 10:11:41,788 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:11:41,788 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:11:41,788 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. after waiting 0 ms 2023-07-19 10:11:41,788 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:11:41,788 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:11:41,788 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for b5c7c60d1b53f5c030c3700c00c30fd2: 2023-07-19 10:11:41,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 10:11:41,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:41,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 5948d96e3c0501914c38fa363f0271a0, disabling compactions & flushes 2023-07-19 10:11:41,795 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:11:41,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:11:41,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. after waiting 0 ms 2023-07-19 10:11:41,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:11:41,796 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:11:41,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 5948d96e3c0501914c38fa363f0271a0: 2023-07-19 10:11:41,799 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:11:41,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761501800"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761501800"}]},"ts":"1689761501800"} 2023-07-19 10:11:41,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761501800"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761501800"}]},"ts":"1689761501800"} 2023-07-19 10:11:41,808 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:11:41,809 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:11:41,809 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761501809"}]},"ts":"1689761501809"} 2023-07-19 10:11:41,813 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-19 10:11:41,818 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:11:41,819 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:11:41,820 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:11:41,820 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:11:41,820 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:11:41,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5948d96e3c0501914c38fa363f0271a0, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5c7c60d1b53f5c030c3700c00c30fd2, ASSIGN}] 2023-07-19 10:11:41,825 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5c7c60d1b53f5c030c3700c00c30fd2, ASSIGN 2023-07-19 10:11:41,826 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5948d96e3c0501914c38fa363f0271a0, ASSIGN 2023-07-19 10:11:41,828 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5c7c60d1b53f5c030c3700c00c30fd2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44313,1689761420775; forceNewPlan=false, retain=false 2023-07-19 10:11:41,828 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5948d96e3c0501914c38fa363f0271a0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35123,1689761420712; forceNewPlan=false, retain=false 2023-07-19 10:11:41,978 INFO [jenkins-hbase4:40385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:11:41,982 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=5948d96e3c0501914c38fa363f0271a0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:41,982 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b5c7c60d1b53f5c030c3700c00c30fd2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:41,982 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761501982"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761501982"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761501982"}]},"ts":"1689761501982"} 2023-07-19 10:11:41,982 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761501982"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761501982"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761501982"}]},"ts":"1689761501982"} 2023-07-19 10:11:41,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 10:11:41,995 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 5948d96e3c0501914c38fa363f0271a0, server=jenkins-hbase4.apache.org,35123,1689761420712}] 2023-07-19 10:11:42,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure b5c7c60d1b53f5c030c3700c00c30fd2, server=jenkins-hbase4.apache.org,44313,1689761420775}] 2023-07-19 10:11:42,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:11:42,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:11:42,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5c7c60d1b53f5c030c3700c00c30fd2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 10:11:42,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5948d96e3c0501914c38fa363f0271a0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 10:11:42,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. service=AccessControlService 2023-07-19 10:11:42,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. service=AccessControlService 2023-07-19 10:11:42,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:42,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 5948d96e3c0501914c38fa363f0271a0 2023-07-19 10:11:42,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:42,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:42,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion b5c7c60d1b53f5c030c3700c00c30fd2 2023-07-19 10:11:42,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5948d96e3c0501914c38fa363f0271a0 2023-07-19 10:11:42,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:42,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5c7c60d1b53f5c030c3700c00c30fd2 2023-07-19 10:11:42,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5c7c60d1b53f5c030c3700c00c30fd2 2023-07-19 10:11:42,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5948d96e3c0501914c38fa363f0271a0 2023-07-19 10:11:42,169 INFO [StoreOpener-b5c7c60d1b53f5c030c3700c00c30fd2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b5c7c60d1b53f5c030c3700c00c30fd2 2023-07-19 10:11:42,170 INFO [StoreOpener-5948d96e3c0501914c38fa363f0271a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5948d96e3c0501914c38fa363f0271a0 2023-07-19 10:11:42,172 DEBUG [StoreOpener-b5c7c60d1b53f5c030c3700c00c30fd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/cf 2023-07-19 10:11:42,172 DEBUG [StoreOpener-b5c7c60d1b53f5c030c3700c00c30fd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/cf 2023-07-19 10:11:42,173 DEBUG [StoreOpener-5948d96e3c0501914c38fa363f0271a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/cf 2023-07-19 10:11:42,173 DEBUG [StoreOpener-5948d96e3c0501914c38fa363f0271a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/cf 2023-07-19 10:11:42,174 INFO [StoreOpener-b5c7c60d1b53f5c030c3700c00c30fd2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5c7c60d1b53f5c030c3700c00c30fd2 columnFamilyName cf 2023-07-19 10:11:42,174 INFO [StoreOpener-5948d96e3c0501914c38fa363f0271a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5948d96e3c0501914c38fa363f0271a0 columnFamilyName cf 2023-07-19 10:11:42,179 INFO [StoreOpener-5948d96e3c0501914c38fa363f0271a0-1] regionserver.HStore(310): Store=5948d96e3c0501914c38fa363f0271a0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:42,180 INFO [StoreOpener-b5c7c60d1b53f5c030c3700c00c30fd2-1] regionserver.HStore(310): Store=b5c7c60d1b53f5c030c3700c00c30fd2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:42,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0 2023-07-19 10:11:42,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0 2023-07-19 10:11:42,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2 2023-07-19 10:11:42,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2 2023-07-19 10:11:42,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5c7c60d1b53f5c030c3700c00c30fd2 2023-07-19 10:11:42,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5948d96e3c0501914c38fa363f0271a0 2023-07-19 10:11:42,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:11:42,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:11:42,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5948d96e3c0501914c38fa363f0271a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65272070, jitterRate=-0.027370363473892212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:42,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5c7c60d1b53f5c030c3700c00c30fd2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74442412, jitterRate=0.10927838087081909}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:42,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5948d96e3c0501914c38fa363f0271a0: 2023-07-19 10:11:42,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5c7c60d1b53f5c030c3700c00c30fd2: 2023-07-19 10:11:42,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0., pid=60, masterSystemTime=1689761502148 2023-07-19 10:11:42,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2., pid=61, masterSystemTime=1689761502157 2023-07-19 10:11:42,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:11:42,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:11:42,214 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=5948d96e3c0501914c38fa363f0271a0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:11:42,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:11:42,214 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761502214"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761502214"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761502214"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761502214"}]},"ts":"1689761502214"} 2023-07-19 10:11:42,217 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b5c7c60d1b53f5c030c3700c00c30fd2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,217 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761502217"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761502217"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761502217"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761502217"}]},"ts":"1689761502217"} 2023-07-19 10:11:42,223 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-19 10:11:42,223 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 5948d96e3c0501914c38fa363f0271a0, server=jenkins-hbase4.apache.org,35123,1689761420712 in 223 msec 2023-07-19 10:11:42,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-19 10:11:42,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure b5c7c60d1b53f5c030c3700c00c30fd2, server=jenkins-hbase4.apache.org,44313,1689761420775 in 219 msec 2023-07-19 10:11:42,227 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5948d96e3c0501914c38fa363f0271a0, ASSIGN in 403 msec 2023-07-19 10:11:42,229 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-19 10:11:42,229 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5c7c60d1b53f5c030c3700c00c30fd2, ASSIGN in 406 msec 2023-07-19 10:11:42,230 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:11:42,230 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761502230"}]},"ts":"1689761502230"} 2023-07-19 10:11:42,232 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-19 10:11:42,235 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:11:42,236 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-19 10:11:42,238 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 10:11:42,241 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:42,241 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:42,241 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:42,241 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:42,243 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:42,244 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:42,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:42,245 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:42,246 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 563 msec 2023-07-19 10:11:42,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 10:11:42,292 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-19 10:11:42,292 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-19 10:11:42,292 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:11:42,297 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-19 10:11:42,298 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:11:42,298 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-19 10:11:42,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 10:11:42,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761502301 (current time:1689761502301). 2023-07-19 10:11:42,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:11:42,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x54834a9d to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:42,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@189ae34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:42,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:42,353 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:42,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54834a9d to 127.0.0.1:56876 2023-07-19 10:11:42,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:42,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x1a3a8820 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:42,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54a3ee58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:42,462 DEBUG [hconnection-0x181702f6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:42,466 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:42,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:42,477 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:42,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a3a8820 to 127.0.0.1:56876 2023-07-19 10:11:42,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:42,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 10:11:42,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:11:42,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 10:11:42,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 10:11:42,486 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 10:11:42,487 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689762102487 2023-07-19 10:11:42,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 10:11:42,488 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,489 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:11:42,489 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:11:42,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 10:11:42,498 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 10:11:42,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 16 msec 2023-07-19 10:11:42,508 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 10:11:42,509 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689762102509 2023-07-19 10:11:42,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,575 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 10:11:42,575 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:42,576 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 10:11:42,576 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 10:11:42,583 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,583 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,585 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:42,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:42,585 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:42,585 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:42,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,587 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,587 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 10:11:42,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,588 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,588 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:11:42,588 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 10:11:42,588 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,589 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 10:11:42,589 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:42,589 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:42,590 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:42,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:42,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:42,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 10:11:42,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:42,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 10:11:42,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,591 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 10:11:42,593 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 10:11:42,593 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 10:11:42,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,591 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:11:42,593 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 10:11:42,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 10:11:42,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,594 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 10:11:42,596 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,598 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,598 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:42,598 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,599 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 10:11:42,599 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:42,599 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,600 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 10:11:42,600 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 10:11:42,600 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:42,600 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 10:11:42,602 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 10:11:42,601 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 10:11:42,602 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 10:11:42,602 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 10:11:42,605 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,605 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:42,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:42,605 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,605 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,605 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:42,606 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:42,606 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:42,606 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:42,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:42,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:42,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 10:11:42,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65efa63e[Count = 1] remaining members to acquire global barrier 2023-07-19 10:11:42,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:42,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:42,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:42,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 10:11:42,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65efa63e[Count = 0] remaining members to acquire global barrier 2023-07-19 10:11:42,612 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 10:11:42,612 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,614 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,614 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,614 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 10:11:42,614 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 10:11:42,614 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35869,1689761420828' in zk 2023-07-19 10:11:42,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,614 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 10:11:42,615 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,615 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 10:11:42,625 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:42,625 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:42,625 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:11:42,625 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. started... 2023-07-19 10:11:42,626 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,631 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 10:11:42,631 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:42,631 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 10:11:42,633 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,633 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:11:42,642 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:42,648 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:42,648 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:11:42,648 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. started... 2023-07-19 10:11:42,654 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5948d96e3c0501914c38fa363f0271a0: 2023-07-19 10:11:42,654 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5c7c60d1b53f5c030c3700c00c30fd2: 2023-07-19 10:11:42,654 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,654 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:42,654 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:11:42,663 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,663 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:42,663 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:11:42,692 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. completed. 2023-07-19 10:11:42,692 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:11:42,692 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:42,692 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:42,692 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,692 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 10:11:42,692 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44313,1689761420775' in zk 2023-07-19 10:11:42,695 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 10:11:42,695 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,695 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:42,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:42,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:42,695 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 10:11:42,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:42,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:42,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:42,700 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. completed. 2023-07-19 10:11:42,700 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:11:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:42,700 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:42,700 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:42,700 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,700 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 10:11:42,700 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35123,1689761420712' in zk 2023-07-19 10:11:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,702 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,702 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 10:11:42,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:42,702 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:42,702 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 10:11:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44313,1689761420775': 2023-07-19 10:11:42,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 10:11:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:42,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:42,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:42,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35123,1689761420712': 2023-07-19 10:11:42,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 10:11:42,710 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 10:11:42,710 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:11:42,710 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:11:42,710 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,710 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:11:42,712 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,712 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,712 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:42,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,712 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:42,712 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,713 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:42,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:42,713 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,714 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,714 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:42,715 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,716 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,716 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:42,718 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:42,722 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:42,722 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:42,722 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:42,722 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,722 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:42,722 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:42,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:42,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-19 10:11:42,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:42,722 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:42,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:42,722 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:42,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:42,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:42,722 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:42,722 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,731 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,731 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,731 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:42,731 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,731 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:42,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:42,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:42,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:42,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:42,731 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:42,732 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,732 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:42,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:42,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:42,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:42,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:42,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-19 10:11:42,793 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:42,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 10:11:42,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:42,795 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:11:42,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,906 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 10:11:42,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,907 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689761502488Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689761502731 (+243 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689761502731Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689761502749 (+18 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689761502788 (+39 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689761502906 (+118 ms) 2023-07-19 10:11:42,910 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 10:11:42,913 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 416 msec 2023-07-19 10:11:43,095 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:43,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 10:11:43,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:11:43,110 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35123] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:11:43,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44313] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:11:43,114 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,114 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:11:43,115 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:11:43,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 10:11:43,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761503127 (current time:1689761503127). 2023-07-19 10:11:43,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:11:43,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x23fe1239 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:43,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@282c1a1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:43,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:43,148 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:43,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23fe1239 to 127.0.0.1:56876 2023-07-19 10:11:43,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:43,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x349938a6 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:43,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67a58bd6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:43,258 DEBUG [hconnection-0x2f1189cd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:43,263 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:43,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:43,271 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:43,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x349938a6 to 127.0.0.1:56876 2023-07-19 10:11:43,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:43,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 10:11:43,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:11:43,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 10:11:43,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 10:11:43,286 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 10:11:43,287 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689762103287 2023-07-19 10:11:43,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 10:11:43,287 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,289 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:11:43,289 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:11:43,290 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 10:11:43,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 10:11:43,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-19 10:11:43,293 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 10:11:43,293 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689762103293 2023-07-19 10:11:43,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,335 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 10:11:43,335 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:43,336 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 10:11:43,336 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 10:11:43,378 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,378 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,379 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:43,379 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:43,379 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:43,380 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:43,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:43,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,381 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,381 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,381 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,382 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:11:43,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 10:11:43,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,382 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 10:11:43,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,383 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 10:11:43,383 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:43,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 10:11:43,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 10:11:43,392 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:43,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 10:11:43,393 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 10:11:43,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:43,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,392 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 10:11:43,394 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 10:11:43,394 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 10:11:43,394 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 10:11:43,394 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:11:43,396 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,398 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,398 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:43,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,402 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 10:11:43,402 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:43,404 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 10:11:43,404 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 10:11:43,404 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 10:11:43,405 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,405 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 10:11:43,405 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:43,407 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 10:11:43,407 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 10:11:43,407 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 10:11:43,409 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,409 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:43,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:43,409 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,409 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:43,412 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:43,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:43,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,413 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,415 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,415 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:43,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:43,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:43,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 10:11:43,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f39951e[Count = 1] remaining members to acquire global barrier 2023-07-19 10:11:43,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:43,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:43,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:43,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:43,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:43,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:43,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 10:11:43,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f39951e[Count = 0] remaining members to acquire global barrier 2023-07-19 10:11:43,419 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 10:11:43,419 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,421 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,421 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,421 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,421 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,422 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 10:11:43,422 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 10:11:43,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,422 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,422 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 10:11:43,422 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:11:43,422 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 10:11:43,422 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35869,1689761420828' in zk 2023-07-19 10:11:43,422 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:43,423 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:43,423 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:11:43,423 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:43,423 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:43,423 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:11:43,423 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. started... 2023-07-19 10:11:43,423 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b5c7c60d1b53f5c030c3700c00c30fd2 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 10:11:43,424 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. started... 2023-07-19 10:11:43,424 INFO [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5948d96e3c0501914c38fa363f0271a0 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 10:11:43,424 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 10:11:43,424 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:43,424 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 10:11:43,468 INFO [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/.tmp/cf/9eabaa51d7b242009c4e14293a4c3898 2023-07-19 10:11:43,477 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/.tmp/cf/39e4fcd251854065a6cadeebccbe1d56 2023-07-19 10:11:43,479 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/.tmp/cf/9eabaa51d7b242009c4e14293a4c3898 as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/cf/9eabaa51d7b242009c4e14293a4c3898 2023-07-19 10:11:43,486 INFO [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/cf/9eabaa51d7b242009c4e14293a4c3898, entries=4, sequenceid=6, filesize=5.1 K 2023-07-19 10:11:43,487 INFO [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 5948d96e3c0501914c38fa363f0271a0 in 63ms, sequenceid=6, compaction requested=false 2023-07-19 10:11:43,487 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-19 10:11:43,488 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5948d96e3c0501914c38fa363f0271a0: 2023-07-19 10:11:43,488 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,488 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:43,488 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/cf/9eabaa51d7b242009c4e14293a4c3898] hfiles 2023-07-19 10:11:43,488 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/cf/9eabaa51d7b242009c4e14293a4c3898 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,495 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/.tmp/cf/39e4fcd251854065a6cadeebccbe1d56 as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/cf/39e4fcd251854065a6cadeebccbe1d56 2023-07-19 10:11:43,501 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/cf/39e4fcd251854065a6cadeebccbe1d56, entries=46, sequenceid=6, filesize=7.9 K 2023-07-19 10:11:43,505 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. completed. 2023-07-19 10:11:43,505 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:11:43,505 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:43,505 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:43,505 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,505 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 10:11:43,505 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35123,1689761420712' in zk 2023-07-19 10:11:43,507 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 10:11:43,507 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:43,507 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,507 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 10:11:43,510 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for b5c7c60d1b53f5c030c3700c00c30fd2 in 87ms, sequenceid=6, compaction requested=false 2023-07-19 10:11:43,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,512 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5c7c60d1b53f5c030c3700c00c30fd2: 2023-07-19 10:11:43,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:43,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:43,512 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,512 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:43,512 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/cf/39e4fcd251854065a6cadeebccbe1d56] hfiles 2023-07-19 10:11:43,512 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/cf/39e4fcd251854065a6cadeebccbe1d56 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:43,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:43,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:43,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35123,1689761420712': 2023-07-19 10:11:43,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 10:11:43,535 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. completed. 2023-07-19 10:11:43,535 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:11:43,535 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:43,535 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:43,535 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,535 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 10:11:43,535 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44313,1689761420775' in zk 2023-07-19 10:11:43,537 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,537 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 10:11:43,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:43,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:43,537 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:43,537 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 10:11:43,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:43,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44313,1689761420775': 2023-07-19 10:11:43,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 10:11:43,543 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 10:11:43,543 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:11:43,543 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:11:43,543 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,543 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:11:43,550 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,550 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:43,550 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,551 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:43,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:43,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,552 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,552 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:43,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,553 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:43,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,556 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,556 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,557 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,560 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,560 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,561 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:43,564 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:43,565 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:43,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:43,565 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:43,565 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:43,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:43,565 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,565 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:43,565 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:43,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:43,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:43,565 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:43,565 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:43,565 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,567 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,567 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,567 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:43,567 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,568 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:43,568 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:43,568 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,568 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:43,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:43,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:43,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:43,594 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:43,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 10:11:43,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:43,595 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:11:43,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,646 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 10:11:43,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,647 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689761503287Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689761503565 (+278 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689761503565Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689761503589 (+24 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689761503606 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689761503646 (+40 ms) 2023-07-19 10:11:43,650 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 10:11:43,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 362 msec 2023-07-19 10:11:43,896 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:43,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 10:11:43,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:11:43,933 DEBUG [Listener at jenkins-hbase4.apache.org/37821] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 10:11:43,937 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 10:11:43,940 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35123] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 10:11:43,940 DEBUG [Listener at jenkins-hbase4.apache.org/37821] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 10:11:43,943 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 10:11:43,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35869] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 10:11:43,944 DEBUG [Listener at jenkins-hbase4.apache.org/37821] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 10:11:43,949 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 10:11:43,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44313] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 10:11:43,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 10:11:43,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:43,956 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:11:43,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-19 10:11:43,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 10:11:43,959 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:11:43,962 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:11:43,963 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:11:43,963 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7 empty. 2023-07-19 10:11:43,963 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19 empty. 2023-07-19 10:11:43,964 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:11:43,964 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:11:43,964 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 10:11:43,977 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-19 10:11:43,978 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => bfeebef51cffac61b4cc8a5de0b1bfd7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:11:43,979 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => eb8860d49b7bb07aea6d9b3c4535ed19, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:11:43,997 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:43,998 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing bfeebef51cffac61b4cc8a5de0b1bfd7, disabling compactions & flushes 2023-07-19 10:11:43,998 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. 2023-07-19 10:11:43,998 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. 2023-07-19 10:11:43,998 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. after waiting 0 ms 2023-07-19 10:11:43,998 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. 2023-07-19 10:11:43,998 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. 2023-07-19 10:11:43,998 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for bfeebef51cffac61b4cc8a5de0b1bfd7: 2023-07-19 10:11:44,004 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:44,004 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing eb8860d49b7bb07aea6d9b3c4535ed19, disabling compactions & flushes 2023-07-19 10:11:44,004 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. 2023-07-19 10:11:44,004 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. 2023-07-19 10:11:44,005 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. after waiting 0 ms 2023-07-19 10:11:44,005 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. 2023-07-19 10:11:44,005 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. 2023-07-19 10:11:44,005 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for eb8860d49b7bb07aea6d9b3c4535ed19: 2023-07-19 10:11:44,007 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:11:44,009 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761504008"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761504008"}]},"ts":"1689761504008"} 2023-07-19 10:11:44,009 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761504008"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761504008"}]},"ts":"1689761504008"} 2023-07-19 10:11:44,011 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:11:44,012 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:11:44,013 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761504013"}]},"ts":"1689761504013"} 2023-07-19 10:11:44,014 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-19 10:11:44,017 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:11:44,018 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:11:44,018 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:11:44,018 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:11:44,019 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:11:44,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bfeebef51cffac61b4cc8a5de0b1bfd7, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb8860d49b7bb07aea6d9b3c4535ed19, ASSIGN}] 2023-07-19 10:11:44,022 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb8860d49b7bb07aea6d9b3c4535ed19, ASSIGN 2023-07-19 10:11:44,022 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bfeebef51cffac61b4cc8a5de0b1bfd7, ASSIGN 2023-07-19 10:11:44,023 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bfeebef51cffac61b4cc8a5de0b1bfd7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35123,1689761420712; forceNewPlan=false, retain=false 2023-07-19 10:11:44,023 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb8860d49b7bb07aea6d9b3c4535ed19, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35869,1689761420828; forceNewPlan=false, retain=false 2023-07-19 10:11:44,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 10:11:44,173 INFO [jenkins-hbase4:40385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:11:44,176 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=eb8860d49b7bb07aea6d9b3c4535ed19, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:44,176 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bfeebef51cffac61b4cc8a5de0b1bfd7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:44,177 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761504176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761504176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761504176"}]},"ts":"1689761504176"} 2023-07-19 10:11:44,177 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761504176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761504176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761504176"}]},"ts":"1689761504176"} 2023-07-19 10:11:44,179 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure bfeebef51cffac61b4cc8a5de0b1bfd7, server=jenkins-hbase4.apache.org,35123,1689761420712}] 2023-07-19 10:11:44,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure eb8860d49b7bb07aea6d9b3c4535ed19, server=jenkins-hbase4.apache.org,35869,1689761420828}] 2023-07-19 10:11:44,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 10:11:44,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. 2023-07-19 10:11:44,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bfeebef51cffac61b4cc8a5de0b1bfd7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7.', STARTKEY => '', ENDKEY => '2'} 2023-07-19 10:11:44,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. service=AccessControlService 2023-07-19 10:11:44,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:44,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:11:44,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:44,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:11:44,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:11:44,338 INFO [StoreOpener-bfeebef51cffac61b4cc8a5de0b1bfd7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:11:44,339 DEBUG [StoreOpener-bfeebef51cffac61b4cc8a5de0b1bfd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/cf 2023-07-19 10:11:44,339 DEBUG [StoreOpener-bfeebef51cffac61b4cc8a5de0b1bfd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/cf 2023-07-19 10:11:44,340 INFO [StoreOpener-bfeebef51cffac61b4cc8a5de0b1bfd7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfeebef51cffac61b4cc8a5de0b1bfd7 columnFamilyName cf 2023-07-19 10:11:44,341 INFO [StoreOpener-bfeebef51cffac61b4cc8a5de0b1bfd7-1] regionserver.HStore(310): Store=bfeebef51cffac61b4cc8a5de0b1bfd7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:44,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:11:44,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:11:44,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. 2023-07-19 10:11:44,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eb8860d49b7bb07aea6d9b3c4535ed19, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19.', STARTKEY => '2', ENDKEY => ''} 2023-07-19 10:11:44,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. service=AccessControlService 2023-07-19 10:11:44,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:44,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:11:44,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:44,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:11:44,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:11:44,345 INFO [StoreOpener-eb8860d49b7bb07aea6d9b3c4535ed19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:11:44,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:11:44,347 DEBUG [StoreOpener-eb8860d49b7bb07aea6d9b3c4535ed19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/cf 2023-07-19 10:11:44,347 DEBUG [StoreOpener-eb8860d49b7bb07aea6d9b3c4535ed19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/cf 2023-07-19 10:11:44,347 INFO [StoreOpener-eb8860d49b7bb07aea6d9b3c4535ed19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb8860d49b7bb07aea6d9b3c4535ed19 columnFamilyName cf 2023-07-19 10:11:44,348 INFO [StoreOpener-eb8860d49b7bb07aea6d9b3c4535ed19-1] regionserver.HStore(310): Store=eb8860d49b7bb07aea6d9b3c4535ed19/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:44,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:11:44,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:11:44,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:11:44,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bfeebef51cffac61b4cc8a5de0b1bfd7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74002261, jitterRate=0.10271961987018585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:44,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bfeebef51cffac61b4cc8a5de0b1bfd7: 2023-07-19 10:11:44,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:11:44,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7., pid=69, masterSystemTime=1689761504332 2023-07-19 10:11:44,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:11:44,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eb8860d49b7bb07aea6d9b3c4535ed19; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75261555, jitterRate=0.12148456275463104}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:44,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eb8860d49b7bb07aea6d9b3c4535ed19: 2023-07-19 10:11:44,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19., pid=70, masterSystemTime=1689761504340 2023-07-19 10:11:44,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. 2023-07-19 10:11:44,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. 2023-07-19 10:11:44,360 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bfeebef51cffac61b4cc8a5de0b1bfd7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:44,361 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761504360"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761504360"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761504360"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761504360"}]},"ts":"1689761504360"} 2023-07-19 10:11:44,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. 2023-07-19 10:11:44,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. 2023-07-19 10:11:44,361 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=eb8860d49b7bb07aea6d9b3c4535ed19, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:44,361 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761504361"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761504361"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761504361"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761504361"}]},"ts":"1689761504361"} 2023-07-19 10:11:44,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-19 10:11:44,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure bfeebef51cffac61b4cc8a5de0b1bfd7, server=jenkins-hbase4.apache.org,35123,1689761420712 in 184 msec 2023-07-19 10:11:44,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-19 10:11:44,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure eb8860d49b7bb07aea6d9b3c4535ed19, server=jenkins-hbase4.apache.org,35869,1689761420828 in 179 msec 2023-07-19 10:11:44,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bfeebef51cffac61b4cc8a5de0b1bfd7, ASSIGN in 346 msec 2023-07-19 10:11:44,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-19 10:11:44,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb8860d49b7bb07aea6d9b3c4535ed19, ASSIGN in 347 msec 2023-07-19 10:11:44,368 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:11:44,368 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761504368"}]},"ts":"1689761504368"} 2023-07-19 10:11:44,370 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-19 10:11:44,372 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:11:44,373 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-19 10:11:44,375 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 10:11:44,376 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:44,376 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:44,376 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:44,376 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:44,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:44,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:44,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:44,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:44,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:44,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:44,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:44,380 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:44,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 426 msec 2023-07-19 10:11:44,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 10:11:44,562 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-19 10:11:44,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions bfeebef51cffac61b4cc8a5de0b1bfd7, eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:11:44,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bfeebef51cffac61b4cc8a5de0b1bfd7, eb8860d49b7bb07aea6d9b3c4535ed19], force=true 2023-07-19 10:11:44,601 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bfeebef51cffac61b4cc8a5de0b1bfd7, eb8860d49b7bb07aea6d9b3c4535ed19], force=true 2023-07-19 10:11:44,601 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bfeebef51cffac61b4cc8a5de0b1bfd7, eb8860d49b7bb07aea6d9b3c4535ed19], force=true 2023-07-19 10:11:44,601 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bfeebef51cffac61b4cc8a5de0b1bfd7, eb8860d49b7bb07aea6d9b3c4535ed19], force=true 2023-07-19 10:11:44,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 10:11:44,628 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bfeebef51cffac61b4cc8a5de0b1bfd7, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb8860d49b7bb07aea6d9b3c4535ed19, UNASSIGN}] 2023-07-19 10:11:44,629 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bfeebef51cffac61b4cc8a5de0b1bfd7, UNASSIGN 2023-07-19 10:11:44,629 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb8860d49b7bb07aea6d9b3c4535ed19, UNASSIGN 2023-07-19 10:11:44,630 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bfeebef51cffac61b4cc8a5de0b1bfd7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:44,630 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=eb8860d49b7bb07aea6d9b3c4535ed19, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:44,630 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761504630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761504630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761504630"}]},"ts":"1689761504630"} 2023-07-19 10:11:44,630 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761504630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761504630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761504630"}]},"ts":"1689761504630"} 2023-07-19 10:11:44,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure bfeebef51cffac61b4cc8a5de0b1bfd7, server=jenkins-hbase4.apache.org,35123,1689761420712}] 2023-07-19 10:11:44,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure eb8860d49b7bb07aea6d9b3c4535ed19, server=jenkins-hbase4.apache.org,35869,1689761420828}] 2023-07-19 10:11:44,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 10:11:44,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:11:44,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bfeebef51cffac61b4cc8a5de0b1bfd7, disabling compactions & flushes 2023-07-19 10:11:44,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. 2023-07-19 10:11:44,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. 2023-07-19 10:11:44,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. after waiting 0 ms 2023-07-19 10:11:44,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. 2023-07-19 10:11:44,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing bfeebef51cffac61b4cc8a5de0b1bfd7 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 10:11:44,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:11:44,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eb8860d49b7bb07aea6d9b3c4535ed19, disabling compactions & flushes 2023-07-19 10:11:44,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. 2023-07-19 10:11:44,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. 2023-07-19 10:11:44,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. after waiting 0 ms 2023-07-19 10:11:44,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. 2023-07-19 10:11:44,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing eb8860d49b7bb07aea6d9b3c4535ed19 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 10:11:44,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/.tmp/cf/a42b895bc89c44e6813f9e1219c9156a 2023-07-19 10:11:44,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/.tmp/cf/b6fe301493c548c4975d5fd13ffe561b 2023-07-19 10:11:44,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/.tmp/cf/a42b895bc89c44e6813f9e1219c9156a as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/cf/a42b895bc89c44e6813f9e1219c9156a 2023-07-19 10:11:44,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/.tmp/cf/b6fe301493c548c4975d5fd13ffe561b as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/cf/b6fe301493c548c4975d5fd13ffe561b 2023-07-19 10:11:44,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/cf/a42b895bc89c44e6813f9e1219c9156a, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 10:11:44,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for bfeebef51cffac61b4cc8a5de0b1bfd7 in 38ms, sequenceid=5, compaction requested=false 2023-07-19 10:11:44,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 10:11:44,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/cf/b6fe301493c548c4975d5fd13ffe561b, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 10:11:44,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for eb8860d49b7bb07aea6d9b3c4535ed19 in 52ms, sequenceid=5, compaction requested=false 2023-07-19 10:11:44,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 10:11:44,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:11:44,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7. 2023-07-19 10:11:44,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bfeebef51cffac61b4cc8a5de0b1bfd7: 2023-07-19 10:11:44,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:11:44,879 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bfeebef51cffac61b4cc8a5de0b1bfd7, regionState=CLOSED 2023-07-19 10:11:44,880 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761504879"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761504879"}]},"ts":"1689761504879"} 2023-07-19 10:11:44,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-19 10:11:44,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure bfeebef51cffac61b4cc8a5de0b1bfd7, server=jenkins-hbase4.apache.org,35123,1689761420712 in 249 msec 2023-07-19 10:11:44,886 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bfeebef51cffac61b4cc8a5de0b1bfd7, UNASSIGN in 261 msec 2023-07-19 10:11:44,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 10:11:44,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:11:44,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19. 2023-07-19 10:11:44,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eb8860d49b7bb07aea6d9b3c4535ed19: 2023-07-19 10:11:44,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:11:44,890 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=eb8860d49b7bb07aea6d9b3c4535ed19, regionState=CLOSED 2023-07-19 10:11:44,890 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761504890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761504890"}]},"ts":"1689761504890"} 2023-07-19 10:11:44,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-19 10:11:44,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure eb8860d49b7bb07aea6d9b3c4535ed19, server=jenkins-hbase4.apache.org,35869,1689761420828 in 260 msec 2023-07-19 10:11:44,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-19 10:11:44,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eb8860d49b7bb07aea6d9b3c4535ed19, UNASSIGN in 267 msec 2023-07-19 10:11:44,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 10:11:44,989 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-19 10:11:44,991 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503952.bfeebef51cffac61b4cc8a5de0b1bfd7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:44,991 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761503952.eb8860d49b7bb07aea6d9b3c4535ed19.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:44,991 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:45,046 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9e2d65f761cd82a2b062c24189cdb1f, ASSIGN}] 2023-07-19 10:11:45,047 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9e2d65f761cd82a2b062c24189cdb1f, ASSIGN 2023-07-19 10:11:45,048 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9e2d65f761cd82a2b062c24189cdb1f, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,35123,1689761420712; forceNewPlan=false, retain=false 2023-07-19 10:11:45,198 INFO [jenkins-hbase4:40385] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 10:11:45,200 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f9e2d65f761cd82a2b062c24189cdb1f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,200 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689761505200"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761505200"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761505200"}]},"ts":"1689761505200"} 2023-07-19 10:11:45,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure f9e2d65f761cd82a2b062c24189cdb1f, server=jenkins-hbase4.apache.org,35123,1689761420712}] 2023-07-19 10:11:45,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 10:11:45,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f. 2023-07-19 10:11:45,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f9e2d65f761cd82a2b062c24189cdb1f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f.', STARTKEY => '', ENDKEY => ''} 2023-07-19 10:11:45,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f. service=AccessControlService 2023-07-19 10:11:45,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:45,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f9e2d65f761cd82a2b062c24189cdb1f 2023-07-19 10:11:45,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:45,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f9e2d65f761cd82a2b062c24189cdb1f 2023-07-19 10:11:45,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f9e2d65f761cd82a2b062c24189cdb1f 2023-07-19 10:11:45,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/.regioninfo 2023-07-19 10:11:45,377 INFO [StoreOpener-f9e2d65f761cd82a2b062c24189cdb1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f9e2d65f761cd82a2b062c24189cdb1f 2023-07-19 10:11:45,378 DEBUG [StoreOpener-f9e2d65f761cd82a2b062c24189cdb1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/cf 2023-07-19 10:11:45,379 DEBUG [StoreOpener-f9e2d65f761cd82a2b062c24189cdb1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/cf 2023-07-19 10:11:45,379 INFO [StoreOpener-f9e2d65f761cd82a2b062c24189cdb1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9e2d65f761cd82a2b062c24189cdb1f columnFamilyName cf 2023-07-19 10:11:45,408 DEBUG [StoreOpener-f9e2d65f761cd82a2b062c24189cdb1f-1] regionserver.HStore(539): loaded hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/cf/a42b895bc89c44e6813f9e1219c9156a.bfeebef51cffac61b4cc8a5de0b1bfd7->hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/cf/a42b895bc89c44e6813f9e1219c9156a-top 2023-07-19 10:11:45,415 DEBUG [StoreOpener-f9e2d65f761cd82a2b062c24189cdb1f-1] regionserver.HStore(539): loaded hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/cf/b6fe301493c548c4975d5fd13ffe561b.eb8860d49b7bb07aea6d9b3c4535ed19->hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/cf/b6fe301493c548c4975d5fd13ffe561b-top 2023-07-19 10:11:45,415 INFO [StoreOpener-f9e2d65f761cd82a2b062c24189cdb1f-1] regionserver.HStore(310): Store=f9e2d65f761cd82a2b062c24189cdb1f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:45,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f 2023-07-19 10:11:45,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f 2023-07-19 10:11:45,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f9e2d65f761cd82a2b062c24189cdb1f 2023-07-19 10:11:45,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f9e2d65f761cd82a2b062c24189cdb1f; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59933438, jitterRate=-0.10692217946052551}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:45,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f9e2d65f761cd82a2b062c24189cdb1f: 2023-07-19 10:11:45,428 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f., pid=77, masterSystemTime=1689761505354 2023-07-19 10:11:45,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f.,because compaction is disabled. 2023-07-19 10:11:45,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f. 2023-07-19 10:11:45,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f. 2023-07-19 10:11:45,431 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f9e2d65f761cd82a2b062c24189cdb1f, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,431 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689761505431"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761505431"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761505431"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761505431"}]},"ts":"1689761505431"} 2023-07-19 10:11:45,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-19 10:11:45,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure f9e2d65f761cd82a2b062c24189cdb1f, server=jenkins-hbase4.apache.org,35123,1689761420712 in 231 msec 2023-07-19 10:11:45,437 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-19 10:11:45,437 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9e2d65f761cd82a2b062c24189cdb1f, ASSIGN in 389 msec 2023-07-19 10:11:45,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bfeebef51cffac61b4cc8a5de0b1bfd7, eb8860d49b7bb07aea6d9b3c4535ed19], force=true in 844 msec 2023-07-19 10:11:45,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 10:11:45,711 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-19 10:11:45,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 10:11:45,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761505712 (current time:1689761505712). 2023-07-19 10:11:45,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:11:45,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x58c687b6 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:45,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22c4d271, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:45,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:45,747 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:45,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58c687b6 to 127.0.0.1:56876 2023-07-19 10:11:45,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:45,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x6ba9eaaa to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:45,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7be3b5e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:45,766 DEBUG [hconnection-0x36d3682-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:45,769 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:45,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:45,777 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:45,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ba9eaaa to 127.0.0.1:56876 2023-07-19 10:11:45,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:45,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 10:11:45,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:11:45,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 10:11:45,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 10:11:45,783 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 10:11:45,784 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689762105784 2023-07-19 10:11:45,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 10:11:45,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,784 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:11:45,789 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:11:45,790 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 10:11:45,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 10:11:45,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-19 10:11:45,792 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 10:11:45,793 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689762105793 2023-07-19 10:11:45,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,812 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 10:11:45,812 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:45,814 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-19 10:11:45,814 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-19 10:11:45,884 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,884 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,885 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:45,885 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:45,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:45,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:45,885 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:45,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:45,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:45,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:45,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:45,887 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,888 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,888 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:11:45,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 10:11:45,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 10:11:45,889 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:45,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,890 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,890 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 10:11:45,890 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:45,891 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 10:11:45,892 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 10:11:45,892 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 10:11:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 10:11:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 10:11:45,892 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 10:11:45,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 10:11:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,892 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:11:45,892 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 10:11:45,894 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,894 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,894 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:45,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,895 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 10:11:45,895 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:45,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,896 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 10:11:45,896 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 10:11:45,896 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 10:11:45,896 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:45,896 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 10:11:45,897 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 10:11:45,897 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 10:11:45,897 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 10:11:45,899 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,899 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,899 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:45,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:45,899 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,899 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:45,899 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,900 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:45,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-19 10:11:45,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f18af6[Count = 0] remaining members to acquire global barrier 2023-07-19 10:11:45,902 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-19 10:11:45,902 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,907 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,907 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,907 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,907 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 10:11:45,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,907 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 10:11:45,907 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,907 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:11:45,907 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 10:11:45,907 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 10:11:45,907 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 10:11:45,907 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35869,1689761420828' in zk 2023-07-19 10:11:45,907 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44313,1689761420775' in zk 2023-07-19 10:11:45,909 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 10:11:45,909 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 10:11:45,909 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:45,909 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:45,909 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 10:11:45,909 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 10:11:45,920 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:45,920 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f. 2023-07-19 10:11:45,920 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:45,920 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f. started... 2023-07-19 10:11:45,921 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f9e2d65f761cd82a2b062c24189cdb1f: 2023-07-19 10:11:45,921 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,921 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:45,922 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/cf/a42b895bc89c44e6813f9e1219c9156a.bfeebef51cffac61b4cc8a5de0b1bfd7->hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/cf/a42b895bc89c44e6813f9e1219c9156a-top, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/cf/b6fe301493c548c4975d5fd13ffe561b.eb8860d49b7bb07aea6d9b3c4535ed19->hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/cf/b6fe301493c548c4975d5fd13ffe561b-top] hfiles 2023-07-19 10:11:45,922 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/cf/a42b895bc89c44e6813f9e1219c9156a.bfeebef51cffac61b4cc8a5de0b1bfd7 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,922 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/cf/b6fe301493c548c4975d5fd13ffe561b.eb8860d49b7bb07aea6d9b3c4535ed19 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,932 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f. completed. 2023-07-19 10:11:45,932 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f. 2023-07-19 10:11:45,932 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:45,932 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:45,932 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,932 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 10:11:45,932 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35123,1689761420712' in zk 2023-07-19 10:11:45,938 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 10:11:45,938 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,938 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:45,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:45,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:45,938 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 10:11:45,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:45,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:45,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:45,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:45,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:45,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:45,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:45,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,35123,1689761420712': 2023-07-19 10:11:45,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-19 10:11:45,943 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-19 10:11:45,943 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:11:45,943 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:11:45,943 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,943 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:11:45,946 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,946 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,946 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,946 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:45,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,946 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,946 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,946 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:45,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:45,947 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:45,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:45,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:45,947 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:45,947 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:45,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:45,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:45,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:45,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,950 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:45,950 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:45,951 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:45,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:45,960 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0004_000001 (auth:SIMPLE) 2023-07-19 10:11:45,960 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:45,960 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:45,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:45,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:45,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:45,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:45,960 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:45,971 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:45,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,971 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:45,971 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:45,971 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:45,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:45,971 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,971 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:45,971 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:45,971 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:45,972 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,972 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:11:45,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,972 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,972 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:11:45,972 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:11:45,972 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,972 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:45,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:45,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:45,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:45,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:45,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:46,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:46,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-19 10:11:46,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:46,038 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:46,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689761505784Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689761505971 (+187 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689761505971Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689761505976 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689761505995 (+19 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689761506037 (+42 ms) 2023-07-19 10:11:46,042 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 10:11:46,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 253 msec 2023-07-19 10:11:46,093 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:46,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 10:11:46,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:11:46,096 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761506096 2023-07-19 10:11:46,096 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35157, tgtDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761506096, rawTgtDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761506096, srcFsUri=hdfs://localhost:35157, srcDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:11:46,124 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:11:46,125 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1215494631_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761506096, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761506096/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:46,125 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc, snapshotDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-19 10:11:46,135 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761506096/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:46,224 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:46,225 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:46,225 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:46,226 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:47,036 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:11:47,322 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-1779263710242158178.jar 2023-07-19 10:11:47,322 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:47,323 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:47,410 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-3442417623944614891.jar 2023-07-19 10:11:47,411 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:47,411 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:47,412 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:47,413 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:47,413 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:47,414 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:47,414 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:11:47,415 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:11:47,416 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:11:47,416 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:11:47,417 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:11:47,417 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:11:47,418 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:11:47,418 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:11:47,418 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:11:47,419 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:11:47,419 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:47,420 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:47,420 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:47,420 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:47,421 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:47,421 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:47,422 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:49,061 WARN [Listener at jenkins-hbase4.apache.org/37821] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:11:49,067 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-19 10:11:49,069 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-19 10:11:49,241 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:11:49,241 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:11:49,966 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0005_000001 (auth:SIMPLE) 2023-07-19 10:11:56,199 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0005_000001 (auth:SIMPLE) 2023-07-19 10:11:58,486 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0005_000001 (auth:SIMPLE) 2023-07-19 10:12:02,716 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0005_000001 (auth:SIMPLE) 2023-07-19 10:12:04,490 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:12:04,493 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:12:04,504 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,505 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:12:04,505 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:12:04,505 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-818487594_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,506 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 10:12:04,506 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 10:12:04,506 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-818487594_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761506096/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761506096/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,507 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761506096/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 10:12:04,507 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761506096/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 10:12:04,515 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 10:12:04,522 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761524522"}]},"ts":"1689761524522"} 2023-07-19 10:12:04,524 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-19 10:12:04,525 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-19 10:12:04,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9e2d65f761cd82a2b062c24189cdb1f, UNASSIGN}] 2023-07-19 10:12:04,529 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9e2d65f761cd82a2b062c24189cdb1f, UNASSIGN 2023-07-19 10:12:04,530 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f9e2d65f761cd82a2b062c24189cdb1f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:04,530 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689761524529"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761524529"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761524529"}]},"ts":"1689761524529"} 2023-07-19 10:12:04,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure f9e2d65f761cd82a2b062c24189cdb1f, server=jenkins-hbase4.apache.org,35123,1689761420712}] 2023-07-19 10:12:04,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 10:12:04,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f9e2d65f761cd82a2b062c24189cdb1f 2023-07-19 10:12:04,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f9e2d65f761cd82a2b062c24189cdb1f, disabling compactions & flushes 2023-07-19 10:12:04,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f. 2023-07-19 10:12:04,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f. 2023-07-19 10:12:04,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f. after waiting 0 ms 2023-07-19 10:12:04,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f. 2023-07-19 10:12:04,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-19 10:12:04,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:04,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f. 2023-07-19 10:12:04,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f9e2d65f761cd82a2b062c24189cdb1f: 2023-07-19 10:12:04,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f9e2d65f761cd82a2b062c24189cdb1f 2023-07-19 10:12:04,701 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f9e2d65f761cd82a2b062c24189cdb1f, regionState=CLOSED 2023-07-19 10:12:04,701 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689761524701"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761524701"}]},"ts":"1689761524701"} 2023-07-19 10:12:04,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-19 10:12:04,704 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure f9e2d65f761cd82a2b062c24189cdb1f, server=jenkins-hbase4.apache.org,35123,1689761420712 in 172 msec 2023-07-19 10:12:04,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-19 10:12:04,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f9e2d65f761cd82a2b062c24189cdb1f, UNASSIGN in 178 msec 2023-07-19 10:12:04,707 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761524706"}]},"ts":"1689761524706"} 2023-07-19 10:12:04,708 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-19 10:12:04,711 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-19 10:12:04,713 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 196 msec 2023-07-19 10:12:04,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 10:12:04,823 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-19 10:12:04,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,827 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,827 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,829 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,831 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,831 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,832 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,831 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,832 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 10:12:04,832 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f 2023-07-19 10:12:04,832 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 10:12:04,832 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:12:04,833 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:12:04,833 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 10:12:04,833 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 10:12:04,833 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,833 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:04,833 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,833 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:04,833 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,834 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:04,834 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,834 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:04,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:04,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:04,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:04,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:04,836 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/recovered.edits] 2023-07-19 10:12:04,837 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/recovered.edits] 2023-07-19 10:12:04,837 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/recovered.edits] 2023-07-19 10:12:04,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 10:12:04,843 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/cf/a42b895bc89c44e6813f9e1219c9156a.bfeebef51cffac61b4cc8a5de0b1bfd7 to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/cf/a42b895bc89c44e6813f9e1219c9156a.bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:12:04,843 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/cf/b6fe301493c548c4975d5fd13ffe561b to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/cf/b6fe301493c548c4975d5fd13ffe561b 2023-07-19 10:12:04,847 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/cf/b6fe301493c548c4975d5fd13ffe561b.eb8860d49b7bb07aea6d9b3c4535ed19 to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/cf/b6fe301493c548c4975d5fd13ffe561b.eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:12:04,854 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/cf/a42b895bc89c44e6813f9e1219c9156a to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/cf/a42b895bc89c44e6813f9e1219c9156a 2023-07-19 10:12:04,855 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/recovered.edits/8.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19/recovered.edits/8.seqid 2023-07-19 10:12:04,856 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eb8860d49b7bb07aea6d9b3c4535ed19 2023-07-19 10:12:04,857 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/recovered.edits/12.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f/recovered.edits/12.seqid 2023-07-19 10:12:04,858 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f9e2d65f761cd82a2b062c24189cdb1f 2023-07-19 10:12:04,858 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/recovered.edits/8.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7/recovered.edits/8.seqid 2023-07-19 10:12:04,859 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bfeebef51cffac61b4cc8a5de0b1bfd7 2023-07-19 10:12:04,859 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 10:12:04,861 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,868 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-19 10:12:04,870 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-19 10:12:04,871 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,871 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-19 10:12:04,871 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761524871"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:04,873 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-19 10:12:04,873 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f9e2d65f761cd82a2b062c24189cdb1f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689761503953.f9e2d65f761cd82a2b062c24189cdb1f.', STARTKEY => '', ENDKEY => ''}] 2023-07-19 10:12:04,874 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-19 10:12:04,874 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761524874"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:04,875 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-19 10:12:04,879 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:04,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 55 msec 2023-07-19 10:12:04,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 10:12:04,939 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-19 10:12:04,940 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:04,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:04,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:04,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 10:12:04,945 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761524945"}]},"ts":"1689761524945"} 2023-07-19 10:12:04,946 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-19 10:12:04,948 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-19 10:12:04,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5948d96e3c0501914c38fa363f0271a0, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5c7c60d1b53f5c030c3700c00c30fd2, UNASSIGN}] 2023-07-19 10:12:04,951 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5948d96e3c0501914c38fa363f0271a0, UNASSIGN 2023-07-19 10:12:04,951 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5c7c60d1b53f5c030c3700c00c30fd2, UNASSIGN 2023-07-19 10:12:04,952 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=5948d96e3c0501914c38fa363f0271a0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:04,952 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b5c7c60d1b53f5c030c3700c00c30fd2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:04,952 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761524952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761524952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761524952"}]},"ts":"1689761524952"} 2023-07-19 10:12:04,952 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761524952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761524952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761524952"}]},"ts":"1689761524952"} 2023-07-19 10:12:04,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 5948d96e3c0501914c38fa363f0271a0, server=jenkins-hbase4.apache.org,35123,1689761420712}] 2023-07-19 10:12:04,955 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure b5c7c60d1b53f5c030c3700c00c30fd2, server=jenkins-hbase4.apache.org,44313,1689761420775}] 2023-07-19 10:12:05,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 10:12:05,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5948d96e3c0501914c38fa363f0271a0 2023-07-19 10:12:05,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5948d96e3c0501914c38fa363f0271a0, disabling compactions & flushes 2023-07-19 10:12:05,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:12:05,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:12:05,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. after waiting 0 ms 2023-07-19 10:12:05,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:12:05,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b5c7c60d1b53f5c030c3700c00c30fd2 2023-07-19 10:12:05,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5c7c60d1b53f5c030c3700c00c30fd2, disabling compactions & flushes 2023-07-19 10:12:05,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:12:05,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:12:05,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. after waiting 0 ms 2023-07-19 10:12:05,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:12:05,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:12:05,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:12:05,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:05,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0. 2023-07-19 10:12:05,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5948d96e3c0501914c38fa363f0271a0: 2023-07-19 10:12:05,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:05,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2. 2023-07-19 10:12:05,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5c7c60d1b53f5c030c3700c00c30fd2: 2023-07-19 10:12:05,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5948d96e3c0501914c38fa363f0271a0 2023-07-19 10:12:05,126 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=5948d96e3c0501914c38fa363f0271a0, regionState=CLOSED 2023-07-19 10:12:05,127 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761525126"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761525126"}]},"ts":"1689761525126"} 2023-07-19 10:12:05,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b5c7c60d1b53f5c030c3700c00c30fd2 2023-07-19 10:12:05,127 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b5c7c60d1b53f5c030c3700c00c30fd2, regionState=CLOSED 2023-07-19 10:12:05,128 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761525127"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761525127"}]},"ts":"1689761525127"} 2023-07-19 10:12:05,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-19 10:12:05,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 5948d96e3c0501914c38fa363f0271a0, server=jenkins-hbase4.apache.org,35123,1689761420712 in 175 msec 2023-07-19 10:12:05,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-19 10:12:05,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure b5c7c60d1b53f5c030c3700c00c30fd2, server=jenkins-hbase4.apache.org,44313,1689761420775 in 175 msec 2023-07-19 10:12:05,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5948d96e3c0501914c38fa363f0271a0, UNASSIGN in 182 msec 2023-07-19 10:12:05,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-19 10:12:05,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5c7c60d1b53f5c030c3700c00c30fd2, UNASSIGN in 183 msec 2023-07-19 10:12:05,135 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761525135"}]},"ts":"1689761525135"} 2023-07-19 10:12:05,137 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-19 10:12:05,140 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-19 10:12:05,142 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 201 msec 2023-07-19 10:12:05,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 10:12:05,248 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-19 10:12:05,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,252 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,253 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,255 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,257 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,257 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,258 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,258 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 10:12:05,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 10:12:05,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 10:12:05,260 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,260 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,260 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2 2023-07-19 10:12:05,260 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0 2023-07-19 10:12:05,260 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,260 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,260 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,260 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,262 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-19 10:12:05,262 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 10:12:05,262 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,263 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/recovered.edits] 2023-07-19 10:12:05,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 10:12:05,264 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/recovered.edits] 2023-07-19 10:12:05,269 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/cf/39e4fcd251854065a6cadeebccbe1d56 to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/cf/39e4fcd251854065a6cadeebccbe1d56 2023-07-19 10:12:05,273 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/cf/9eabaa51d7b242009c4e14293a4c3898 to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/cf/9eabaa51d7b242009c4e14293a4c3898 2023-07-19 10:12:05,277 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/recovered.edits/9.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2/recovered.edits/9.seqid 2023-07-19 10:12:05,277 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/recovered.edits/9.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0/recovered.edits/9.seqid 2023-07-19 10:12:05,278 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5c7c60d1b53f5c030c3700c00c30fd2 2023-07-19 10:12:05,278 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5948d96e3c0501914c38fa363f0271a0 2023-07-19 10:12:05,278 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 10:12:05,281 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,284 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-19 10:12:05,286 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-19 10:12:05,287 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,287 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-19 10:12:05,287 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761525287"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:05,287 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761525287"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:05,289 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 10:12:05,289 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5948d96e3c0501914c38fa363f0271a0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689761501680.5948d96e3c0501914c38fa363f0271a0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b5c7c60d1b53f5c030c3700c00c30fd2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689761501680.b5c7c60d1b53f5c030c3700c00c30fd2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 10:12:05,289 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-19 10:12:05,289 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761525289"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:05,291 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-19 10:12:05,294 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 45 msec 2023-07-19 10:12:05,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 10:12:05,365 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-19 10:12:05,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 10:12:05,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 10:12:05,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-19 10:12:05,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,423 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 748) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818487594_17 at /127.0.0.1:42474 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818487594_17 at /127.0.0.1:51250 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase4.apache.org/172.31.14.131:41097 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2049502399_1 at /127.0.0.1:51236 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818487594_17 at /127.0.0.1:55484 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2049502399_1 at /127.0.0.1:42440 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3947 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 891) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=586 (was 497) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=2395 (was 3028) 2023-07-19 10:12:05,423 WARN [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-19 10:12:05,446 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=586, ProcessCount=184, AvailableMemoryMB=2393 2023-07-19 10:12:05,446 WARN [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-19 10:12:05,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 10:12:05,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:05,452 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:12:05,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-19 10:12:05,454 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:12:05,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 10:12:05,457 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841 2023-07-19 10:12:05,457 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0 2023-07-19 10:12:05,457 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841 empty. 2023-07-19 10:12:05,458 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0 empty. 2023-07-19 10:12:05,458 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841 2023-07-19 10:12:05,458 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0 2023-07-19 10:12:05,458 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 10:12:05,491 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 10:12:05,493 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => e0cdb55c48a567f954c9f606948ec841, NAME => 'testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:12:05,495 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c374cd93a1f33e40463b0135de5442f0, NAME => 'testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:12:05,547 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:05,547 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:05,547 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c374cd93a1f33e40463b0135de5442f0, disabling compactions & flushes 2023-07-19 10:12:05,547 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:05,547 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing e0cdb55c48a567f954c9f606948ec841, disabling compactions & flushes 2023-07-19 10:12:05,547 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:05,548 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:05,548 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. after waiting 0 ms 2023-07-19 10:12:05,548 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:05,548 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:05,548 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. after waiting 0 ms 2023-07-19 10:12:05,548 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:05,548 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c374cd93a1f33e40463b0135de5442f0: 2023-07-19 10:12:05,548 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:05,548 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:05,548 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for e0cdb55c48a567f954c9f606948ec841: 2023-07-19 10:12:05,551 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:12:05,552 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761525552"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761525552"}]},"ts":"1689761525552"} 2023-07-19 10:12:05,552 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761525552"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761525552"}]},"ts":"1689761525552"} 2023-07-19 10:12:05,553 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:12:05,554 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:12:05,554 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761525554"}]},"ts":"1689761525554"} 2023-07-19 10:12:05,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 10:12:05,559 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 10:12:05,565 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:12:05,566 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:12:05,566 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:12:05,566 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:12:05,566 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:12:05,566 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0cdb55c48a567f954c9f606948ec841, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c374cd93a1f33e40463b0135de5442f0, ASSIGN}] 2023-07-19 10:12:05,572 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c374cd93a1f33e40463b0135de5442f0, ASSIGN 2023-07-19 10:12:05,572 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0cdb55c48a567f954c9f606948ec841, ASSIGN 2023-07-19 10:12:05,573 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c374cd93a1f33e40463b0135de5442f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35123,1689761420712; forceNewPlan=false, retain=false 2023-07-19 10:12:05,573 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0cdb55c48a567f954c9f606948ec841, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35869,1689761420828; forceNewPlan=false, retain=false 2023-07-19 10:12:05,723 INFO [jenkins-hbase4:40385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:12:05,727 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c374cd93a1f33e40463b0135de5442f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:05,727 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e0cdb55c48a567f954c9f606948ec841, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:05,727 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761525727"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761525727"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761525727"}]},"ts":"1689761525727"} 2023-07-19 10:12:05,727 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761525727"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761525727"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761525727"}]},"ts":"1689761525727"} 2023-07-19 10:12:05,730 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure e0cdb55c48a567f954c9f606948ec841, server=jenkins-hbase4.apache.org,35869,1689761420828}] 2023-07-19 10:12:05,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure c374cd93a1f33e40463b0135de5442f0, server=jenkins-hbase4.apache.org,35123,1689761420712}] 2023-07-19 10:12:05,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 10:12:05,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:05,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c374cd93a1f33e40463b0135de5442f0, NAME => 'testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 10:12:05,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. service=AccessControlService 2023-07-19 10:12:05,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:05,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:12:05,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e0cdb55c48a567f954c9f606948ec841, NAME => 'testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 10:12:05,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c374cd93a1f33e40463b0135de5442f0 2023-07-19 10:12:05,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:05,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. service=AccessControlService 2023-07-19 10:12:05,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c374cd93a1f33e40463b0135de5442f0 2023-07-19 10:12:05,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c374cd93a1f33e40463b0135de5442f0 2023-07-19 10:12:05,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:12:05,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState e0cdb55c48a567f954c9f606948ec841 2023-07-19 10:12:05,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:05,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e0cdb55c48a567f954c9f606948ec841 2023-07-19 10:12:05,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e0cdb55c48a567f954c9f606948ec841 2023-07-19 10:12:05,892 INFO [StoreOpener-c374cd93a1f33e40463b0135de5442f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c374cd93a1f33e40463b0135de5442f0 2023-07-19 10:12:05,893 DEBUG [StoreOpener-c374cd93a1f33e40463b0135de5442f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/cf 2023-07-19 10:12:05,893 DEBUG [StoreOpener-c374cd93a1f33e40463b0135de5442f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/cf 2023-07-19 10:12:05,894 INFO [StoreOpener-c374cd93a1f33e40463b0135de5442f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c374cd93a1f33e40463b0135de5442f0 columnFamilyName cf 2023-07-19 10:12:05,894 INFO [StoreOpener-c374cd93a1f33e40463b0135de5442f0-1] regionserver.HStore(310): Store=c374cd93a1f33e40463b0135de5442f0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:12:05,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0 2023-07-19 10:12:05,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0 2023-07-19 10:12:05,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c374cd93a1f33e40463b0135de5442f0 2023-07-19 10:12:05,903 INFO [StoreOpener-e0cdb55c48a567f954c9f606948ec841-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e0cdb55c48a567f954c9f606948ec841 2023-07-19 10:12:05,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:12:05,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c374cd93a1f33e40463b0135de5442f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66306870, jitterRate=-0.011950641870498657}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:12:05,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c374cd93a1f33e40463b0135de5442f0: 2023-07-19 10:12:05,906 DEBUG [StoreOpener-e0cdb55c48a567f954c9f606948ec841-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/cf 2023-07-19 10:12:05,906 DEBUG [StoreOpener-e0cdb55c48a567f954c9f606948ec841-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/cf 2023-07-19 10:12:05,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0., pid=94, masterSystemTime=1689761525882 2023-07-19 10:12:05,907 INFO [StoreOpener-e0cdb55c48a567f954c9f606948ec841-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0cdb55c48a567f954c9f606948ec841 columnFamilyName cf 2023-07-19 10:12:05,907 INFO [StoreOpener-e0cdb55c48a567f954c9f606948ec841-1] regionserver.HStore(310): Store=e0cdb55c48a567f954c9f606948ec841/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:12:05,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:05,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841 2023-07-19 10:12:05,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:05,909 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c374cd93a1f33e40463b0135de5442f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:05,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841 2023-07-19 10:12:05,909 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761525909"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761525909"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761525909"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761525909"}]},"ts":"1689761525909"} 2023-07-19 10:12:05,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-19 10:12:05,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure c374cd93a1f33e40463b0135de5442f0, server=jenkins-hbase4.apache.org,35123,1689761420712 in 181 msec 2023-07-19 10:12:05,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c374cd93a1f33e40463b0135de5442f0, ASSIGN in 347 msec 2023-07-19 10:12:05,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e0cdb55c48a567f954c9f606948ec841 2023-07-19 10:12:05,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:12:05,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e0cdb55c48a567f954c9f606948ec841; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62634923, jitterRate=-0.06666691601276398}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:12:05,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e0cdb55c48a567f954c9f606948ec841: 2023-07-19 10:12:05,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841., pid=93, masterSystemTime=1689761525882 2023-07-19 10:12:05,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:05,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:05,920 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e0cdb55c48a567f954c9f606948ec841, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:05,921 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761525920"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761525920"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761525920"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761525920"}]},"ts":"1689761525920"} 2023-07-19 10:12:05,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-19 10:12:05,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure e0cdb55c48a567f954c9f606948ec841, server=jenkins-hbase4.apache.org,35869,1689761420828 in 192 msec 2023-07-19 10:12:05,926 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-19 10:12:05,926 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0cdb55c48a567f954c9f606948ec841, ASSIGN in 358 msec 2023-07-19 10:12:05,926 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:12:05,927 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761525926"}]},"ts":"1689761525926"} 2023-07-19 10:12:05,928 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 10:12:05,931 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:12:05,931 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-19 10:12:05,933 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 10:12:05,936 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,936 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,936 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,936 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:05,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:05,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:05,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:05,939 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 489 msec 2023-07-19 10:12:06,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 10:12:06,058 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-19 10:12:06,059 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-19 10:12:06,059 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:12:06,067 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-19 10:12:06,068 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:12:06,068 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-19 10:12:06,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:12:06,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761526076 (current time:1689761526076). 2023-07-19 10:12:06,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:12:06,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x436fa1a0 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:06,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79bc254b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:06,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:06,125 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:06,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x436fa1a0 to 127.0.0.1:56876 2023-07-19 10:12:06,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:06,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x69f20bae to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:06,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57aec591, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:06,138 DEBUG [hconnection-0x4fa02452-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:06,139 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:06,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:06,145 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:06,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69f20bae to 127.0.0.1:56876 2023-07-19 10:12:06,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:06,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 10:12:06,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:12:06,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:12:06,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:12:06,150 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:12:06,151 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689762126151 2023-07-19 10:12:06,151 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 10:12:06,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:12:06,152 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:12:06,152 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:12:06,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 10:12:06,153 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:12:06,158 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-19 10:12:06,162 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 10:12:06,162 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689762126162 2023-07-19 10:12:06,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,181 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-19 10:12:06,181 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:06,182 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 10:12:06,182 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 10:12:06,187 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,187 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,193 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:06,193 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:06,193 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:06,193 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:06,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:06,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:06,194 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,194 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,195 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,195 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:12:06,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 10:12:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 10:12:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 10:12:06,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,196 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 10:12:06,196 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 10:12:06,196 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 10:12:06,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,196 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 10:12:06,197 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:06,196 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 10:12:06,200 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 10:12:06,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,200 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 10:12:06,200 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 10:12:06,200 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:06,200 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:06,201 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 10:12:06,203 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 10:12:06,203 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 10:12:06,203 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 10:12:06,200 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 10:12:06,203 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 10:12:06,203 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 10:12:06,205 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,205 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,205 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:06,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:06,206 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,206 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,207 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,207 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,207 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:06,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:06,207 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:06,207 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,207 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:06,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:06,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:06,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 10:12:06,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45b9f6c4[Count = 1] remaining members to acquire global barrier 2023-07-19 10:12:06,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:06,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:06,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:06,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:06,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:06,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 10:12:06,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45b9f6c4[Count = 0] remaining members to acquire global barrier 2023-07-19 10:12:06,215 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 10:12:06,215 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,217 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,217 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,217 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,217 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:12:06,217 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 10:12:06,217 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:12:06,217 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44313,1689761420775' in zk 2023-07-19 10:12:06,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,217 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,218 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:12:06,218 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,218 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:12:06,219 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:06,219 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:06,219 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:06,219 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. started... 2023-07-19 10:12:06,221 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 10:12:06,227 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:06,227 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 10:12:06,230 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:06,231 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:06,241 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:06,241 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e0cdb55c48a567f954c9f606948ec841: 2023-07-19 10:12:06,242 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. started... 2023-07-19 10:12:06,242 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,243 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c374cd93a1f33e40463b0135de5442f0: 2023-07-19 10:12:06,243 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:06,243 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:12:06,243 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,243 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:06,243 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:12:06,252 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:06,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:12:06,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:06,254 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:12:06,280 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. completed. 2023-07-19 10:12:06,280 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:06,280 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. completed. 2023-07-19 10:12:06,280 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:06,281 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:06,281 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,281 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:06,281 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 10:12:06,281 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35869,1689761420828' in zk 2023-07-19 10:12:06,281 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:06,281 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:06,281 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,281 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 10:12:06,281 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35123,1689761420712' in zk 2023-07-19 10:12:06,282 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,283 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 10:12:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:06,283 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 10:12:06,284 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:06,284 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 10:12:06,284 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:06,284 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,286 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 10:12:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:06,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35869,1689761420828': 2023-07-19 10:12:06,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 10:12:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:06,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35123,1689761420712': 2023-07-19 10:12:06,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 10:12:06,296 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 10:12:06,296 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:12:06,296 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:12:06,296 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,296 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:12:06,298 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,298 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,298 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:06,298 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:06,298 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,298 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:06,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,298 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:06,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:06,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:06,299 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,300 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:06,301 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:06,303 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,303 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,303 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,307 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:06,307 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:06,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:06,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:06,307 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,307 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:06,308 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:06,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:06,308 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:06,308 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:06,308 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,308 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,307 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:06,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:06,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:06,308 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,310 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,310 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,310 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,310 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,310 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,310 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,310 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,310 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:06,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:06,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,371 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 10:12:06,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,371 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689761526151Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689761526310 (+159 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689761526310Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689761526318 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689761526338 (+20 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689761526371 (+33 ms) 2023-07-19 10:12:06,375 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 10:12:06,376 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 223 msec 2023-07-19 10:12:06,454 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:06,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:12:06,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:12:06,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35869] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:12:06,463 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35123] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:12:06,465 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 10:12:06,466 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:06,467 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:12:06,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:12:06,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761526479 (current time:1689761526479). 2023-07-19 10:12:06,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:12:06,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x62c31b01 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:06,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c8f21bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:06,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:06,489 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:06,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62c31b01 to 127.0.0.1:56876 2023-07-19 10:12:06,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:06,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x638a312f to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:06,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19eb254c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:06,505 DEBUG [hconnection-0x4cbc6d17-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:06,508 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:06,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:06,513 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:06,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x638a312f to 127.0.0.1:56876 2023-07-19 10:12:06,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:06,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 10:12:06,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:12:06,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:12:06,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:12:06,518 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:12:06,519 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689762126519 2023-07-19 10:12:06,519 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 10:12:06,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:12:06,520 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:12:06,520 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:12:06,521 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:12:06,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 10:12:06,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-07-19 10:12:06,523 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 10:12:06,525 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689762126525 2023-07-19 10:12:06,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,539 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-19 10:12:06,539 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:06,541 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 10:12:06,541 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 10:12:06,541 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,541 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,542 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:06,542 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:06,543 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:06,542 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:06,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:06,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:06,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:06,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:06,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:06,543 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,543 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,543 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,543 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:12:06,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 10:12:06,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 10:12:06,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 10:12:06,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,544 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 10:12:06,544 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 10:12:06,544 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 10:12:06,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,545 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 10:12:06,545 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:06,547 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 10:12:06,547 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 10:12:06,547 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:06,547 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 10:12:06,547 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,547 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 10:12:06,547 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 10:12:06,547 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:06,552 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 10:12:06,552 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 10:12:06,552 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 10:12:06,552 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:06,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:06,552 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:06,554 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,554 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:06,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:06,555 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,555 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,555 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,555 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:06,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,556 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 10:12:06,556 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 10:12:06,556 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 10:12:06,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:06,558 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 10:12:06,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d7f761b[Count = 1] remaining members to acquire global barrier 2023-07-19 10:12:06,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:06,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:06,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:06,560 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,560 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:06,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:06,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:06,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 10:12:06,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d7f761b[Count = 0] remaining members to acquire global barrier 2023-07-19 10:12:06,563 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 10:12:06,563 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,573 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,573 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,573 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,574 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:12:06,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,574 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:12:06,574 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 10:12:06,574 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44313,1689761420775' in zk 2023-07-19 10:12:06,574 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:12:06,574 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:06,574 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:06,574 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,575 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:06,575 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:06,575 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:06,575 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,575 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:12:06,575 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. started... 2023-07-19 10:12:06,575 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:06,575 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. started... 2023-07-19 10:12:06,575 INFO [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c374cd93a1f33e40463b0135de5442f0 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-19 10:12:06,575 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e0cdb55c48a567f954c9f606948ec841 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-19 10:12:06,576 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 10:12:06,576 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:06,576 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 10:12:06,613 INFO [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/.tmp/cf/fa454b4ee8b346f4a1df7a2456106c3e 2023-07-19 10:12:06,613 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/.tmp/cf/de87089061fa4d5dbe9bce6dea3b5487 2023-07-19 10:12:06,620 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/.tmp/cf/fa454b4ee8b346f4a1df7a2456106c3e as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/cf/fa454b4ee8b346f4a1df7a2456106c3e 2023-07-19 10:12:06,620 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/.tmp/cf/de87089061fa4d5dbe9bce6dea3b5487 as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/cf/de87089061fa4d5dbe9bce6dea3b5487 2023-07-19 10:12:06,621 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:06,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:12:06,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:06,622 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:12:06,626 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/cf/de87089061fa4d5dbe9bce6dea3b5487, entries=2, sequenceid=6, filesize=5.0 K 2023-07-19 10:12:06,627 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for e0cdb55c48a567f954c9f606948ec841 in 52ms, sequenceid=6, compaction requested=false 2023-07-19 10:12:06,627 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 10:12:06,627 INFO [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/cf/fa454b4ee8b346f4a1df7a2456106c3e, entries=48, sequenceid=6, filesize=8.1 K 2023-07-19 10:12:06,628 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e0cdb55c48a567f954c9f606948ec841: 2023-07-19 10:12:06,628 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,628 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:06,628 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/cf/de87089061fa4d5dbe9bce6dea3b5487] hfiles 2023-07-19 10:12:06,628 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/cf/de87089061fa4d5dbe9bce6dea3b5487 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,628 INFO [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for c374cd93a1f33e40463b0135de5442f0 in 53ms, sequenceid=6, compaction requested=false 2023-07-19 10:12:06,630 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c374cd93a1f33e40463b0135de5442f0: 2023-07-19 10:12:06,630 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,630 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:06,630 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/cf/fa454b4ee8b346f4a1df7a2456106c3e] hfiles 2023-07-19 10:12:06,630 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/cf/fa454b4ee8b346f4a1df7a2456106c3e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,664 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. completed. 2023-07-19 10:12:06,664 DEBUG [rs(jenkins-hbase4.apache.org,35123,1689761420712)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:06,664 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:06,664 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:06,664 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,664 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 10:12:06,664 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35123,1689761420712' in zk 2023-07-19 10:12:06,666 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 10:12:06,666 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,666 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:06,666 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 10:12:06,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:06,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:06,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:06,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:06,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:06,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:06,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:06,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:06,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35123,1689761420712': 2023-07-19 10:12:06,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 10:12:06,822 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:06,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:12:06,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:06,824 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:12:07,047 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. completed. 2023-07-19 10:12:07,047 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:07,047 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:07,047 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:07,047 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:07,047 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 10:12:07,047 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35869,1689761420828' in zk 2023-07-19 10:12:07,049 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 10:12:07,050 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:07,050 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 10:12:07,060 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:07,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:07,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:07,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:07,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:07,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:07,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35869,1689761420828': 2023-07-19 10:12:07,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 10:12:07,067 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 10:12:07,067 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:12:07,067 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:12:07,067 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,067 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:12:07,069 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,070 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,070 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,070 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,071 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,072 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:07,072 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:07,072 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,072 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,073 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:07,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:07,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:07,076 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,076 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:07,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:07,077 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:07,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:07,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:07,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:07,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:07,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:07,081 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:07,081 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,081 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:07,081 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:07,081 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:07,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:07,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:07,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:07,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:07,081 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:07,081 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:07,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:07,081 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:07,081 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,081 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,081 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:07,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,081 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,081 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,083 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:07,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,083 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,084 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:07,084 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:07,084 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,084 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,085 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-19 10:12:07,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,124 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:07,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:12:07,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:07,125 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 10:12:07,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,591 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 10:12:07,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,592 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689761526519Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689761527083 (+564 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689761527083Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689761527091 (+8 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689761527114 (+23 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689761527591 (+477 ms) 2023-07-19 10:12:07,595 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 10:12:07,598 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.0750 sec 2023-07-19 10:12:07,625 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:07,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:12:07,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:12:07,627 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761527627 2023-07-19 10:12:07,628 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35157, tgtDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761527627, rawTgtDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761527627, srcFsUri=hdfs://localhost:35157, srcDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:12:07,662 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:12:07,663 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1028535219_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761527627, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761527627/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,663 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc, snapshotDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-19 10:12:07,675 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761527627/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:08,156 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:08,156 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:08,157 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:08,157 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:08,880 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0005_000001 (auth:SIMPLE) 2023-07-19 10:12:09,400 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-4738782219820505560.jar 2023-07-19 10:12:09,401 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,402 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,490 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-6426822938902665450.jar 2023-07-19 10:12:09,490 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,491 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,492 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,492 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,493 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,493 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,494 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:12:09,495 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:12:09,495 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:12:09,496 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:12:09,496 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:12:09,497 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:12:09,497 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:12:09,498 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:12:09,498 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:12:09,499 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:12:09,500 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:09,501 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:09,502 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:12:09,502 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:09,502 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:09,503 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:12:09,504 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:12:10,345 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:12:10,756 WARN [Listener at jenkins-hbase4.apache.org/37821] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:12:10,759 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-19 10:12:10,933 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:12:10,934 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:12:11,083 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0006_000001 (auth:SIMPLE) 2023-07-19 10:12:17,844 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0006_000001 (auth:SIMPLE) 2023-07-19 10:12:20,124 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:12:20,125 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:12:20,130 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:20,130 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:12:20,131 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:12:20,131 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-818487594_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:20,131 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 10:12:20,131 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 10:12:20,131 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-818487594_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761527627/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761527627/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:20,132 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761527627/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 10:12:20,132 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761527627/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 10:12:20,136 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 10:12:20,141 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761540141"}]},"ts":"1689761540141"} 2023-07-19 10:12:20,142 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 10:12:20,144 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-19 10:12:20,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0cdb55c48a567f954c9f606948ec841, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c374cd93a1f33e40463b0135de5442f0, UNASSIGN}] 2023-07-19 10:12:20,149 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0cdb55c48a567f954c9f606948ec841, UNASSIGN 2023-07-19 10:12:20,149 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c374cd93a1f33e40463b0135de5442f0, UNASSIGN 2023-07-19 10:12:20,149 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e0cdb55c48a567f954c9f606948ec841, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:20,149 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c374cd93a1f33e40463b0135de5442f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:20,150 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761540149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761540149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761540149"}]},"ts":"1689761540149"} 2023-07-19 10:12:20,150 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761540149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761540149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761540149"}]},"ts":"1689761540149"} 2023-07-19 10:12:20,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure e0cdb55c48a567f954c9f606948ec841, server=jenkins-hbase4.apache.org,35869,1689761420828}] 2023-07-19 10:12:20,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure c374cd93a1f33e40463b0135de5442f0, server=jenkins-hbase4.apache.org,35123,1689761420712}] 2023-07-19 10:12:20,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 10:12:20,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e0cdb55c48a567f954c9f606948ec841 2023-07-19 10:12:20,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e0cdb55c48a567f954c9f606948ec841, disabling compactions & flushes 2023-07-19 10:12:20,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:20,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:20,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. after waiting 0 ms 2023-07-19 10:12:20,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:20,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c374cd93a1f33e40463b0135de5442f0 2023-07-19 10:12:20,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c374cd93a1f33e40463b0135de5442f0, disabling compactions & flushes 2023-07-19 10:12:20,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:20,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:20,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. after waiting 0 ms 2023-07-19 10:12:20,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:20,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:12:20,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:20,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841. 2023-07-19 10:12:20,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e0cdb55c48a567f954c9f606948ec841: 2023-07-19 10:12:20,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:12:20,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:20,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0. 2023-07-19 10:12:20,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c374cd93a1f33e40463b0135de5442f0: 2023-07-19 10:12:20,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e0cdb55c48a567f954c9f606948ec841 2023-07-19 10:12:20,339 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e0cdb55c48a567f954c9f606948ec841, regionState=CLOSED 2023-07-19 10:12:20,339 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761540339"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761540339"}]},"ts":"1689761540339"} 2023-07-19 10:12:20,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c374cd93a1f33e40463b0135de5442f0 2023-07-19 10:12:20,340 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c374cd93a1f33e40463b0135de5442f0, regionState=CLOSED 2023-07-19 10:12:20,340 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761540340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761540340"}]},"ts":"1689761540340"} 2023-07-19 10:12:20,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-19 10:12:20,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-19 10:12:20,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure c374cd93a1f33e40463b0135de5442f0, server=jenkins-hbase4.apache.org,35123,1689761420712 in 191 msec 2023-07-19 10:12:20,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure e0cdb55c48a567f954c9f606948ec841, server=jenkins-hbase4.apache.org,35869,1689761420828 in 192 msec 2023-07-19 10:12:20,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e0cdb55c48a567f954c9f606948ec841, UNASSIGN in 207 msec 2023-07-19 10:12:20,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-19 10:12:20,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c374cd93a1f33e40463b0135de5442f0, UNASSIGN in 207 msec 2023-07-19 10:12:20,354 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761540354"}]},"ts":"1689761540354"} 2023-07-19 10:12:20,355 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 10:12:20,357 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-19 10:12:20,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 221 msec 2023-07-19 10:12:20,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 10:12:20,443 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-19 10:12:20,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,451 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,452 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,453 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,457 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,457 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,457 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,457 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,457 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0 2023-07-19 10:12:20,457 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841 2023-07-19 10:12:20,458 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 10:12:20,458 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 10:12:20,458 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 10:12:20,458 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 10:12:20,459 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,459 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,459 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,459 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,459 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:20,459 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:20,459 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:20,459 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:20,460 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/recovered.edits] 2023-07-19 10:12:20,460 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/recovered.edits] 2023-07-19 10:12:20,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 10:12:20,465 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/cf/fa454b4ee8b346f4a1df7a2456106c3e to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/cf/fa454b4ee8b346f4a1df7a2456106c3e 2023-07-19 10:12:20,465 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/cf/de87089061fa4d5dbe9bce6dea3b5487 to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/cf/de87089061fa4d5dbe9bce6dea3b5487 2023-07-19 10:12:20,468 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/recovered.edits/9.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0/recovered.edits/9.seqid 2023-07-19 10:12:20,469 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/recovered.edits/9.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841/recovered.edits/9.seqid 2023-07-19 10:12:20,469 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/c374cd93a1f33e40463b0135de5442f0 2023-07-19 10:12:20,469 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testEmptyExportFileSystemState/e0cdb55c48a567f954c9f606948ec841 2023-07-19 10:12:20,469 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 10:12:20,472 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,474 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-19 10:12:20,477 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-19 10:12:20,478 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,478 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-19 10:12:20,478 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761540478"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:20,478 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761540478"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:20,480 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 10:12:20,480 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e0cdb55c48a567f954c9f606948ec841, NAME => 'testtb-testEmptyExportFileSystemState,,1689761525448.e0cdb55c48a567f954c9f606948ec841.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c374cd93a1f33e40463b0135de5442f0, NAME => 'testtb-testEmptyExportFileSystemState,1,1689761525448.c374cd93a1f33e40463b0135de5442f0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 10:12:20,480 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-19 10:12:20,480 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761540480"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:20,482 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-19 10:12:20,484 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:20,484 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 40 msec 2023-07-19 10:12:20,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 10:12:20,561 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-19 10:12:20,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-19 10:12:20,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:20,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-19 10:12:20,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:20,603 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 760) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1724142751_1 at /127.0.0.1:57566 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase4.apache.org/172.31.14.131:40951 from appattempt_1689761429805_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818487594_17 at /127.0.0.1:54040 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2107514926) connection to jenkins-hbase4.apache.org/172.31.14.131:35091 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x484fc19a-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818487594_17 at /127.0.0.1:47556 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4602 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1724142751_1 at /127.0.0.1:47520 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-818487594_17 at /127.0.0.1:57590 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=608 (was 586) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1733 (was 2393) 2023-07-19 10:12:20,603 WARN [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-19 10:12:20,624 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=608, ProcessCount=184, AvailableMemoryMB=1733 2023-07-19 10:12:20,625 WARN [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-19 10:12:20,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 10:12:20,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:20,629 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:12:20,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-19 10:12:20,630 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:12:20,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 10:12:20,633 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936 2023-07-19 10:12:20,633 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678 2023-07-19 10:12:20,633 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936 empty. 2023-07-19 10:12:20,633 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678 empty. 2023-07-19 10:12:20,634 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678 2023-07-19 10:12:20,634 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936 2023-07-19 10:12:20,634 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 10:12:20,649 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-19 10:12:20,650 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 454d39428cd496ab6075b7efa1a7a936, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:12:20,651 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 686f171f9cccc4ac18aa5adc830b0678, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp 2023-07-19 10:12:20,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:20,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 454d39428cd496ab6075b7efa1a7a936, disabling compactions & flushes 2023-07-19 10:12:20,680 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:20,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:20,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:20,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. after waiting 0 ms 2023-07-19 10:12:20,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 686f171f9cccc4ac18aa5adc830b0678, disabling compactions & flushes 2023-07-19 10:12:20,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:20,680 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:20,680 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:20,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:20,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. after waiting 0 ms 2023-07-19 10:12:20,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:20,680 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 454d39428cd496ab6075b7efa1a7a936: 2023-07-19 10:12:20,681 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:20,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 686f171f9cccc4ac18aa5adc830b0678: 2023-07-19 10:12:20,683 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:12:20,684 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761540684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761540684"}]},"ts":"1689761540684"} 2023-07-19 10:12:20,684 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761540684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761540684"}]},"ts":"1689761540684"} 2023-07-19 10:12:20,687 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:12:20,687 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:12:20,687 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761540687"}]},"ts":"1689761540687"} 2023-07-19 10:12:20,689 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-19 10:12:20,692 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:12:20,693 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:12:20,694 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:12:20,694 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:12:20,694 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:12:20,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=454d39428cd496ab6075b7efa1a7a936, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=686f171f9cccc4ac18aa5adc830b0678, ASSIGN}] 2023-07-19 10:12:20,696 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=454d39428cd496ab6075b7efa1a7a936, ASSIGN 2023-07-19 10:12:20,696 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=686f171f9cccc4ac18aa5adc830b0678, ASSIGN 2023-07-19 10:12:20,697 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=454d39428cd496ab6075b7efa1a7a936, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35869,1689761420828; forceNewPlan=false, retain=false 2023-07-19 10:12:20,697 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=686f171f9cccc4ac18aa5adc830b0678, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44313,1689761420775; forceNewPlan=false, retain=false 2023-07-19 10:12:20,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 10:12:20,847 INFO [jenkins-hbase4:40385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:12:20,850 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=686f171f9cccc4ac18aa5adc830b0678, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:20,850 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=454d39428cd496ab6075b7efa1a7a936, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:20,850 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761540850"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761540850"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761540850"}]},"ts":"1689761540850"} 2023-07-19 10:12:20,850 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761540850"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761540850"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761540850"}]},"ts":"1689761540850"} 2023-07-19 10:12:20,852 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 686f171f9cccc4ac18aa5adc830b0678, server=jenkins-hbase4.apache.org,44313,1689761420775}] 2023-07-19 10:12:20,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 454d39428cd496ab6075b7efa1a7a936, server=jenkins-hbase4.apache.org,35869,1689761420828}] 2023-07-19 10:12:20,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 10:12:21,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:21,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 454d39428cd496ab6075b7efa1a7a936, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 10:12:21,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. service=AccessControlService 2023-07-19 10:12:21,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:21,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:12:21,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 686f171f9cccc4ac18aa5adc830b0678, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 10:12:21,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 454d39428cd496ab6075b7efa1a7a936 2023-07-19 10:12:21,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:21,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 454d39428cd496ab6075b7efa1a7a936 2023-07-19 10:12:21,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 454d39428cd496ab6075b7efa1a7a936 2023-07-19 10:12:21,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. service=AccessControlService 2023-07-19 10:12:21,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:12:21,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 686f171f9cccc4ac18aa5adc830b0678 2023-07-19 10:12:21,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:21,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 686f171f9cccc4ac18aa5adc830b0678 2023-07-19 10:12:21,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 686f171f9cccc4ac18aa5adc830b0678 2023-07-19 10:12:21,012 INFO [StoreOpener-454d39428cd496ab6075b7efa1a7a936-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 454d39428cd496ab6075b7efa1a7a936 2023-07-19 10:12:21,013 INFO [StoreOpener-686f171f9cccc4ac18aa5adc830b0678-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 686f171f9cccc4ac18aa5adc830b0678 2023-07-19 10:12:21,014 DEBUG [StoreOpener-454d39428cd496ab6075b7efa1a7a936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/cf 2023-07-19 10:12:21,014 DEBUG [StoreOpener-454d39428cd496ab6075b7efa1a7a936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/cf 2023-07-19 10:12:21,014 INFO [StoreOpener-454d39428cd496ab6075b7efa1a7a936-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 454d39428cd496ab6075b7efa1a7a936 columnFamilyName cf 2023-07-19 10:12:21,014 DEBUG [StoreOpener-686f171f9cccc4ac18aa5adc830b0678-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/cf 2023-07-19 10:12:21,015 INFO [StoreOpener-454d39428cd496ab6075b7efa1a7a936-1] regionserver.HStore(310): Store=454d39428cd496ab6075b7efa1a7a936/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:12:21,018 DEBUG [StoreOpener-686f171f9cccc4ac18aa5adc830b0678-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/cf 2023-07-19 10:12:21,019 INFO [StoreOpener-686f171f9cccc4ac18aa5adc830b0678-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 686f171f9cccc4ac18aa5adc830b0678 columnFamilyName cf 2023-07-19 10:12:21,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936 2023-07-19 10:12:21,020 INFO [StoreOpener-686f171f9cccc4ac18aa5adc830b0678-1] regionserver.HStore(310): Store=686f171f9cccc4ac18aa5adc830b0678/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:12:21,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936 2023-07-19 10:12:21,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 454d39428cd496ab6075b7efa1a7a936 2023-07-19 10:12:21,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678 2023-07-19 10:12:21,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678 2023-07-19 10:12:21,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:12:21,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 454d39428cd496ab6075b7efa1a7a936; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70474318, jitterRate=0.05014917254447937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:12:21,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 454d39428cd496ab6075b7efa1a7a936: 2023-07-19 10:12:21,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936., pid=109, masterSystemTime=1689761541003 2023-07-19 10:12:21,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 686f171f9cccc4ac18aa5adc830b0678 2023-07-19 10:12:21,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:21,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:21,028 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=454d39428cd496ab6075b7efa1a7a936, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:12:21,028 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761541027"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761541027"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761541027"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761541027"}]},"ts":"1689761541027"} 2023-07-19 10:12:21,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 686f171f9cccc4ac18aa5adc830b0678; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71060846, jitterRate=0.05888912081718445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:12:21,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 686f171f9cccc4ac18aa5adc830b0678: 2023-07-19 10:12:21,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678., pid=108, masterSystemTime=1689761541003 2023-07-19 10:12:21,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:21,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:21,031 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=686f171f9cccc4ac18aa5adc830b0678, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,031 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761541031"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761541031"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761541031"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761541031"}]},"ts":"1689761541031"} 2023-07-19 10:12:21,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-19 10:12:21,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 454d39428cd496ab6075b7efa1a7a936, server=jenkins-hbase4.apache.org,35869,1689761420828 in 178 msec 2023-07-19 10:12:21,036 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=454d39428cd496ab6075b7efa1a7a936, ASSIGN in 339 msec 2023-07-19 10:12:21,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-19 10:12:21,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 686f171f9cccc4ac18aa5adc830b0678, server=jenkins-hbase4.apache.org,44313,1689761420775 in 183 msec 2023-07-19 10:12:21,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-19 10:12:21,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=686f171f9cccc4ac18aa5adc830b0678, ASSIGN in 343 msec 2023-07-19 10:12:21,041 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:12:21,041 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761541041"}]},"ts":"1689761541041"} 2023-07-19 10:12:21,042 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-19 10:12:21,045 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:12:21,045 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-19 10:12:21,047 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 10:12:21,048 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:21,048 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:21,048 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:21,048 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:21,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:21,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:21,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:21,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:21,052 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 424 msec 2023-07-19 10:12:21,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 10:12:21,235 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-19 10:12:21,236 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-19 10:12:21,236 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:12:21,239 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-19 10:12:21,239 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:12:21,239 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-19 10:12:21,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 10:12:21,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761541242 (current time:1689761541242). 2023-07-19 10:12:21,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:12:21,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x41419bdf to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:21,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26f0b39b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:21,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:21,261 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:21,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41419bdf to 127.0.0.1:56876 2023-07-19 10:12:21,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:21,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x422792c7 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:21,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ff5663f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:21,271 DEBUG [hconnection-0x2c3a6031-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:21,275 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:21,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:21,282 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:21,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x422792c7 to 127.0.0.1:56876 2023-07-19 10:12:21,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:21,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 10:12:21,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:12:21,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 10:12:21,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 10:12:21,291 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 10:12:21,297 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689762141297 2023-07-19 10:12:21,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 10:12:21,297 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,299 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:12:21,299 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:12:21,300 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 10:12:21,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 10:12:21,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 14 msec 2023-07-19 10:12:21,303 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 10:12:21,304 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689762141304 2023-07-19 10:12:21,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,319 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 10:12:21,319 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:21,321 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 10:12:21,321 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 10:12:21,393 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,393 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,395 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:21,395 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:21,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:21,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:21,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:21,395 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,395 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:21,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:21,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:21,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:21,396 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,396 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,398 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,398 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:12:21,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 10:12:21,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,399 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 10:12:21,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 10:12:21,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,399 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 10:12:21,399 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,400 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 10:12:21,400 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:21,401 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 10:12:21,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 10:12:21,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,402 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:21,402 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 10:12:21,402 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 10:12:21,402 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 10:12:21,402 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:21,402 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 10:12:21,404 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 10:12:21,404 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 10:12:21,404 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 10:12:21,404 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,404 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 10:12:21,404 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:21,405 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 10:12:21,405 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 10:12:21,405 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 10:12:21,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 10:12:21,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:21,406 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:12:21,412 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,412 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,412 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:21,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:21,413 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,413 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:21,413 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,413 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,413 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:21,413 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:21,413 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,413 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:21,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:21,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 10:12:21,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ead89cf[Count = 1] remaining members to acquire global barrier 2023-07-19 10:12:21,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:21,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:21,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:21,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:21,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:21,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 10:12:21,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ead89cf[Count = 0] remaining members to acquire global barrier 2023-07-19 10:12:21,418 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 10:12:21,419 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,420 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,420 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,420 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,420 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,420 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 10:12:21,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,420 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 10:12:21,420 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35123,1689761420712' in zk 2023-07-19 10:12:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,420 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,421 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 10:12:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,421 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:12:21,421 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 10:12:21,421 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:21,421 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:21,421 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:21,421 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. started... 2023-07-19 10:12:21,423 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:21,423 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 454d39428cd496ab6075b7efa1a7a936: 2023-07-19 10:12:21,423 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:21,424 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 10:12:21,424 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:21,424 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 10:12:21,425 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:21,425 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,425 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. started... 2023-07-19 10:12:21,425 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:21,425 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:12:21,426 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 686f171f9cccc4ac18aa5adc830b0678: 2023-07-19 10:12:21,426 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,427 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:21,427 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:12:21,449 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. completed. 2023-07-19 10:12:21,449 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:21,449 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:21,449 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:21,449 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,450 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 10:12:21,450 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35869,1689761420828' in zk 2023-07-19 10:12:21,451 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,451 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 10:12:21,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:21,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:21,452 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:21,452 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 10:12:21,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:21,454 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. completed. 2023-07-19 10:12:21,454 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:21,454 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:21,454 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,454 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,454 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 10:12:21,454 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44313,1689761420775' in zk 2023-07-19 10:12:21,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,456 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,456 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 10:12:21,456 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:21,456 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 10:12:21,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:21,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35869,1689761420828': 2023-07-19 10:12:21,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 10:12:21,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:21,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:21,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:21,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:21,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:21,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44313,1689761420775': 2023-07-19 10:12:21,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 10:12:21,463 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 10:12:21,463 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:12:21,464 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:12:21,464 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,464 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:12:21,466 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,466 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,466 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:21,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,466 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:21,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,467 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,467 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:21,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,467 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:21,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:21,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:21,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:21,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:21,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:21,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:21,468 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:21,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:21,468 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,469 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,471 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:21,471 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,472 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,477 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,477 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:21,477 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,477 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:21,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,477 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:21,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:21,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:21,477 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:21,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:21,477 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:21,477 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,477 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:21,478 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:21,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:21,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:21,477 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:21,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:21,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:21,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,478 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:21,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:21,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:21,480 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:21,480 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,480 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,480 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,480 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,480 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,480 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,570 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 10:12:21,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,571 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689761541297Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689761541477 (+180 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689761541477Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689761541482 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689761541492 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689761541570 (+78 ms) 2023-07-19 10:12:21,574 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 10:12:21,575 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 275 msec 2023-07-19 10:12:21,606 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:21,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 10:12:21,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:12:21,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44313] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:12:21,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35869] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:12:21,663 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,663 DEBUG [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:21,663 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:12:21,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 10:12:21,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761541680 (current time:1689761541680). 2023-07-19 10:12:21,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:12:21,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x52b150a2 to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:21,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2df5892d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:21,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:21,729 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:21,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52b150a2 to 127.0.0.1:56876 2023-07-19 10:12:21,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:21,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(139): Connect 0x2b6f602b to 127.0.0.1:56876 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:21,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@738311a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:21,775 DEBUG [hconnection-0x72be5218-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:21,777 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:21,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:21,786 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:21,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b6f602b to 127.0.0.1:56876 2023-07-19 10:12:21,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:21,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 10:12:21,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:12:21,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 10:12:21,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 10:12:21,794 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 10:12:21,794 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689762141794 2023-07-19 10:12:21,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 10:12:21,795 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,796 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:12:21,797 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:12:21,799 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 10:12:21,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 10:12:21,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-19 10:12:21,802 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 10:12:21,807 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689762141807 2023-07-19 10:12:21,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,860 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 10:12:21,860 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:21,862 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 10:12:21,862 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 10:12:21,863 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,863 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,865 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:21,865 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:21,865 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:21,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:21,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:21,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:21,865 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:21,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:21,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:21,865 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,865 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,866 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,866 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:12:21,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 10:12:21,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 10:12:21,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 10:12:21,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 10:12:21,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 10:12:21,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 10:12:21,868 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,868 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,868 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 10:12:21,868 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:21,868 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 10:12:21,868 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:21,872 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 10:12:21,872 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 10:12:21,872 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 10:12:21,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,876 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 10:12:21,876 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 10:12:21,876 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35123,1689761420712' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 10:12:21,877 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 10:12:21,877 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 10:12:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 10:12:21,879 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 10:12:21,882 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,882 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,882 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:21,882 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:21,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:21,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:21,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:21,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:21,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35869,1689761420828' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 10:12:21,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@100516d6[Count = 1] remaining members to acquire global barrier 2023-07-19 10:12:21,886 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,887 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,887 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:21,888 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,888 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:21,888 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:21,888 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:21,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:21,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44313,1689761420775' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 10:12:21,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@100516d6[Count = 0] remaining members to acquire global barrier 2023-07-19 10:12:21,892 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 10:12:21,892 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,897 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:21,897 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,898 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,898 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 10:12:21,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:21,898 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 10:12:21,898 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,898 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 10:12:21,898 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 10:12:21,898 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35123,1689761420712' in zk 2023-07-19 10:12:21,898 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:21,899 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:21,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,899 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:21,899 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:12:21,899 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. started... 2023-07-19 10:12:21,899 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,899 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:12:21,899 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 686f171f9cccc4ac18aa5adc830b0678 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 10:12:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,899 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 10:12:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:21,900 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:21,900 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. started... 2023-07-19 10:12:21,900 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 454d39428cd496ab6075b7efa1a7a936 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 10:12:21,900 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 10:12:21,901 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:21,901 DEBUG [member: 'jenkins-hbase4.apache.org,35123,1689761420712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 10:12:21,930 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/.tmp/cf/cdf3b78ca8fc4188a51cac239ad0a33b 2023-07-19 10:12:21,937 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/.tmp/cf/5e7b071554e84307bcc52bc6fd844396 2023-07-19 10:12:21,941 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/.tmp/cf/cdf3b78ca8fc4188a51cac239ad0a33b as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/cf/cdf3b78ca8fc4188a51cac239ad0a33b 2023-07-19 10:12:21,950 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/cf/cdf3b78ca8fc4188a51cac239ad0a33b, entries=47, sequenceid=6, filesize=8.0 K 2023-07-19 10:12:21,952 INFO [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 686f171f9cccc4ac18aa5adc830b0678 in 53ms, sequenceid=6, compaction requested=false 2023-07-19 10:12:21,952 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-19 10:12:21,953 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 686f171f9cccc4ac18aa5adc830b0678: 2023-07-19 10:12:21,953 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,953 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:21,953 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/cf/cdf3b78ca8fc4188a51cac239ad0a33b] hfiles 2023-07-19 10:12:21,953 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/cf/cdf3b78ca8fc4188a51cac239ad0a33b for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,955 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/.tmp/cf/5e7b071554e84307bcc52bc6fd844396 as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/cf/5e7b071554e84307bcc52bc6fd844396 2023-07-19 10:12:21,965 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/cf/5e7b071554e84307bcc52bc6fd844396, entries=3, sequenceid=6, filesize=5.0 K 2023-07-19 10:12:21,967 INFO [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 454d39428cd496ab6075b7efa1a7a936 in 67ms, sequenceid=6, compaction requested=false 2023-07-19 10:12:21,978 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 454d39428cd496ab6075b7efa1a7a936: 2023-07-19 10:12:21,979 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,979 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:21,979 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/cf/5e7b071554e84307bcc52bc6fd844396] hfiles 2023-07-19 10:12:21,979 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/cf/5e7b071554e84307bcc52bc6fd844396 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,981 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. completed. 2023-07-19 10:12:21,982 DEBUG [rs(jenkins-hbase4.apache.org,44313,1689761420775)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:21,982 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:21,982 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:21,982 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,982 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 10:12:21,982 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44313,1689761420775' in zk 2023-07-19 10:12:21,984 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 10:12:21,984 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,985 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:21,985 DEBUG [member: 'jenkins-hbase4.apache.org,44313,1689761420775' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 10:12:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:21,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:21,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:21,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:21,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:21,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:21,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44313,1689761420775': 2023-07-19 10:12:21,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44313,1689761420775' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 10:12:22,000 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. completed. 2023-07-19 10:12:22,000 DEBUG [rs(jenkins-hbase4.apache.org,35869,1689761420828)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:22,000 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:22,000 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:22,000 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:22,000 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 10:12:22,000 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35869,1689761420828' in zk 2023-07-19 10:12:22,002 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 10:12:22,002 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:22,002 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:22,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:22,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:22,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:22,002 DEBUG [member: 'jenkins-hbase4.apache.org,35869,1689761420828' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 10:12:22,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:22,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:22,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:22,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:22,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:22,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:22,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:22,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:22,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:22,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35869,1689761420828': 2023-07-19 10:12:22,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35869,1689761420828' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 10:12:22,008 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 10:12:22,008 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:12:22,008 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:12:22,008 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,008 INFO [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:12:22,010 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,010 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:22,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,010 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:22,010 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,010 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,010 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:22,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,010 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:22,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:22,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:22,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:22,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:22,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:22,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:22,011 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:22,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:22,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,012 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:22,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:22,012 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:22,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:22,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:22,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:22,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:22,014 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:22,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:22,014 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:22,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:22,015 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:22,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:22,018 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:22,018 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:22,018 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:22,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:22,018 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:22,018 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:22,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:22,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:22,018 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:22,018 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:22,018 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:22,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:22,018 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:22,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:22,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:22,018 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:22,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:22,018 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:22,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:22,019 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:22,019 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,019 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:22,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:22,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:22,019 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:12:22,019 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,019 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,019 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,019 DEBUG [(jenkins-hbase4.apache.org,40385,1689761419057)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:22,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,099 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:22,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 10:12:22,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:22,101 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:12:22,137 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 10:12:22,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,138 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689761541795Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689761542019 (+224 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689761542019Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689761542024 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689761542046 (+22 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689761542137 (+91 ms) 2023-07-19 10:12:22,142 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 10:12:22,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 346 msec 2023-07-19 10:12:22,401 DEBUG [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:22,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 10:12:22,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:12:22,402 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761542402 2023-07-19 10:12:22,402 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35157, tgtDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761542402, rawTgtDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761542402, srcFsUri=hdfs://localhost:35157, srcDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:12:22,425 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc 2023-07-19 10:12:22,425 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-250904640_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761542402, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761542402/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,425 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35157, inputRoot=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc, snapshotDir=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-19 10:12:22,434 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761542402/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,451 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:22,451 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:22,451 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:22,452 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:23,486 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-6680575940669087721.jar 2023-07-19 10:12:23,487 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:23,487 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:23,570 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/hadoop-8651198502372205103.jar 2023-07-19 10:12:23,571 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:23,571 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:23,572 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:23,572 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:23,573 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:23,573 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:23,574 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:12:23,574 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:12:23,575 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:12:23,575 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:12:23,575 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:12:23,576 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:12:23,576 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:12:23,577 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:12:23,577 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:12:23,578 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:12:23,578 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:23,579 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:23,580 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:12:23,580 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:23,580 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:23,581 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:12:23,581 DEBUG [Listener at jenkins-hbase4.apache.org/37821] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:12:24,157 WARN [Listener at jenkins-hbase4.apache.org/37821] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:12:24,159 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-19 10:12:24,161 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 10:12:25,261 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:12:25,261 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:12:25,267 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0006_000001 (auth:SIMPLE) 2023-07-19 10:12:25,889 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0007_000001 (auth:SIMPLE) 2023-07-19 10:12:25,937 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:12:32,252 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0007_000001 (auth:SIMPLE) 2023-07-19 10:12:34,571 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429805_0007_000001 (auth:SIMPLE) 2023-07-19 10:12:40,368 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:12:40,368 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:12:40,380 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,380 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:12:40,381 INFO [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:12:40,381 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-818487594_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,381 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 10:12:40,381 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 10:12:40,381 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-818487594_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761542402/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761542402/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,382 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761542402/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 10:12:40,382 DEBUG [Listener at jenkins-hbase4.apache.org/37821] snapshot.TestExportSnapshot(367): hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/export-test/export-1689761542402/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 10:12:40,388 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 10:12:40,393 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761560393"}]},"ts":"1689761560393"} 2023-07-19 10:12:40,394 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-19 10:12:40,396 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-19 10:12:40,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=454d39428cd496ab6075b7efa1a7a936, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=686f171f9cccc4ac18aa5adc830b0678, UNASSIGN}] 2023-07-19 10:12:40,399 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=454d39428cd496ab6075b7efa1a7a936, UNASSIGN 2023-07-19 10:12:40,399 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=686f171f9cccc4ac18aa5adc830b0678, UNASSIGN 2023-07-19 10:12:40,399 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=454d39428cd496ab6075b7efa1a7a936, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:12:40,400 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761560399"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761560399"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761560399"}]},"ts":"1689761560399"} 2023-07-19 10:12:40,400 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=686f171f9cccc4ac18aa5adc830b0678, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:12:40,400 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761560400"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761560400"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761560400"}]},"ts":"1689761560400"} 2023-07-19 10:12:40,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 454d39428cd496ab6075b7efa1a7a936, server=jenkins-hbase4.apache.org,35869,1689761420828}] 2023-07-19 10:12:40,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 686f171f9cccc4ac18aa5adc830b0678, server=jenkins-hbase4.apache.org,44313,1689761420775}] 2023-07-19 10:12:40,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 10:12:40,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 454d39428cd496ab6075b7efa1a7a936 2023-07-19 10:12:40,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 686f171f9cccc4ac18aa5adc830b0678 2023-07-19 10:12:40,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 454d39428cd496ab6075b7efa1a7a936, disabling compactions & flushes 2023-07-19 10:12:40,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 686f171f9cccc4ac18aa5adc830b0678, disabling compactions & flushes 2023-07-19 10:12:40,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:40,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:40,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. after waiting 0 ms 2023-07-19 10:12:40,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:40,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:40,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:40,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. after waiting 0 ms 2023-07-19 10:12:40,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:40,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:12:40,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:12:40,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:40,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:40,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936. 2023-07-19 10:12:40,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678. 2023-07-19 10:12:40,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 454d39428cd496ab6075b7efa1a7a936: 2023-07-19 10:12:40,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 686f171f9cccc4ac18aa5adc830b0678: 2023-07-19 10:12:40,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 686f171f9cccc4ac18aa5adc830b0678 2023-07-19 10:12:40,581 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=686f171f9cccc4ac18aa5adc830b0678, regionState=CLOSED 2023-07-19 10:12:40,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 454d39428cd496ab6075b7efa1a7a936 2023-07-19 10:12:40,581 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761560580"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761560580"}]},"ts":"1689761560580"} 2023-07-19 10:12:40,581 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=454d39428cd496ab6075b7efa1a7a936, regionState=CLOSED 2023-07-19 10:12:40,581 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761560581"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761560581"}]},"ts":"1689761560581"} 2023-07-19 10:12:40,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-19 10:12:40,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 686f171f9cccc4ac18aa5adc830b0678, server=jenkins-hbase4.apache.org,44313,1689761420775 in 180 msec 2023-07-19 10:12:40,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-19 10:12:40,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 454d39428cd496ab6075b7efa1a7a936, server=jenkins-hbase4.apache.org,35869,1689761420828 in 182 msec 2023-07-19 10:12:40,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=686f171f9cccc4ac18aa5adc830b0678, UNASSIGN in 187 msec 2023-07-19 10:12:40,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-19 10:12:40,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=454d39428cd496ab6075b7efa1a7a936, UNASSIGN in 188 msec 2023-07-19 10:12:40,588 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761560588"}]},"ts":"1689761560588"} 2023-07-19 10:12:40,589 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-19 10:12:40,591 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-19 10:12:40,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 202 msec 2023-07-19 10:12:40,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 10:12:40,695 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-19 10:12:40,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,700 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,701 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,702 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44313] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,706 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936 2023-07-19 10:12:40,706 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678 2023-07-19 10:12:40,708 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,708 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,708 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,708 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,709 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/recovered.edits] 2023-07-19 10:12:40,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 10:12:40,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 10:12:40,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 10:12:40,709 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/cf, FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/recovered.edits] 2023-07-19 10:12:40,711 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,711 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,711 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:40,711 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:40,711 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,711 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:40,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 10:12:40,713 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 10:12:40,713 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:40,715 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/cf/cdf3b78ca8fc4188a51cac239ad0a33b to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/cf/cdf3b78ca8fc4188a51cac239ad0a33b 2023-07-19 10:12:40,716 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/cf/5e7b071554e84307bcc52bc6fd844396 to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/cf/5e7b071554e84307bcc52bc6fd844396 2023-07-19 10:12:40,720 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/recovered.edits/9.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678/recovered.edits/9.seqid 2023-07-19 10:12:40,721 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/recovered.edits/9.seqid to hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936/recovered.edits/9.seqid 2023-07-19 10:12:40,721 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/686f171f9cccc4ac18aa5adc830b0678 2023-07-19 10:12:40,721 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/454d39428cd496ab6075b7efa1a7a936 2023-07-19 10:12:40,722 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 10:12:40,724 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,726 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-19 10:12:40,728 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-19 10:12:40,730 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,730 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-19 10:12:40,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761560730"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:40,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761560730"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:40,732 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 10:12:40,732 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 454d39428cd496ab6075b7efa1a7a936, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689761540626.454d39428cd496ab6075b7efa1a7a936.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 686f171f9cccc4ac18aa5adc830b0678, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689761540626.686f171f9cccc4ac18aa5adc830b0678.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 10:12:40,732 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-19 10:12:40,732 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761560732"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:40,734 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-19 10:12:40,736 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,737 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 40 msec 2023-07-19 10:12:40,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 10:12:40,815 INFO [Listener at jenkins-hbase4.apache.org/37821] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-19 10:12:40,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 10:12:40,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 10:12:40,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:40,863 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 763), OpenFileDescriptor=896 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=499 (was 608), ProcessCount=184 (was 184), AvailableMemoryMB=1370 (was 1733) 2023-07-19 10:12:40,863 WARN [Listener at jenkins-hbase4.apache.org/37821] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-19 10:12:40,864 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-19 10:12:40,880 INFO [Listener at jenkins-hbase4.apache.org/37821] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 10:12:41,018 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689761429805_0007_01_000001 is : 143 2023-07-19 10:12:46,143 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:12:55,017 INFO [Listener at jenkins-hbase4.apache.org/37821] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 10:13:09,151 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 10:13:09,152 INFO [Listener at jenkins-hbase4.apache.org/37821] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 10:13:09,264 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-19 10:13:09,276 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-19 10:13:09,278 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 10:13:09,295 INFO [Listener at jenkins-hbase4.apache.org/37821] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 10:13:09,399 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 10:13:09,399 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-19 10:13:09,399 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-19 10:13:09,399 INFO [Listener at jenkins-hbase4.apache.org/37821] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 10:13:09,399 DEBUG [Listener at jenkins-hbase4.apache.org/37821] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c9a8426 to 127.0.0.1:56876 2023-07-19 10:13:09,399 DEBUG [Listener at jenkins-hbase4.apache.org/37821] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:09,400 DEBUG [Listener at jenkins-hbase4.apache.org/37821] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-19 10:13:09,400 DEBUG [Listener at jenkins-hbase4.apache.org/37821] util.JVMClusterUtil(257): Found active master hash=2095043435, stopped=false 2023-07-19 10:13:09,400 DEBUG [Listener at jenkins-hbase4.apache.org/37821] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:09,400 DEBUG [Listener at jenkins-hbase4.apache.org/37821] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 10:13:09,400 INFO [Listener at jenkins-hbase4.apache.org/37821] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40385,1689761419057 2023-07-19 10:13:09,401 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 10:13:09,401 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 10:13:09,402 INFO [Listener at jenkins-hbase4.apache.org/37821] procedure2.ProcedureExecutor(629): Stopping 2023-07-19 10:13:09,402 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 10:13:09,402 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:13:09,402 DEBUG [Listener at jenkins-hbase4.apache.org/37821] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3873ce09 to 127.0.0.1:56876 2023-07-19 10:13:09,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:13:09,402 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 10:13:09,402 DEBUG [Listener at jenkins-hbase4.apache.org/37821] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:09,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:13:09,403 INFO [Listener at jenkins-hbase4.apache.org/37821] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35123,1689761420712' ***** 2023-07-19 10:13:09,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:13:09,403 DEBUG [Listener at jenkins-hbase4.apache.org/37821] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:09,403 INFO [Listener at jenkins-hbase4.apache.org/37821] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 10:13:09,403 INFO [Listener at jenkins-hbase4.apache.org/37821] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44313,1689761420775' ***** 2023-07-19 10:13:09,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:13:09,403 DEBUG [Listener at jenkins-hbase4.apache.org/37821] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:09,403 INFO [Listener at jenkins-hbase4.apache.org/37821] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 10:13:09,403 INFO [Listener at jenkins-hbase4.apache.org/37821] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35869,1689761420828' ***** 2023-07-19 10:13:09,403 DEBUG [Listener at jenkins-hbase4.apache.org/37821] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:09,403 INFO [Listener at jenkins-hbase4.apache.org/37821] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 10:13:09,403 INFO [RS:0;jenkins-hbase4:35123] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 10:13:09,403 INFO [RS:1;jenkins-hbase4:44313] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 10:13:09,404 INFO [RS:2;jenkins-hbase4:35869] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 10:13:09,404 INFO [RS:1;jenkins-hbase4:44313] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 10:13:09,404 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 10:13:09,404 INFO [RS:2;jenkins-hbase4:35869] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 10:13:09,404 INFO [RS:0;jenkins-hbase4:35123] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 10:13:09,404 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 10:13:09,404 INFO [RS:2;jenkins-hbase4:35869] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 10:13:09,404 INFO [RS:1;jenkins-hbase4:44313] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 10:13:09,404 INFO [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:13:09,404 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 10:13:09,404 DEBUG [RS:2;jenkins-hbase4:35869] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3690d813 to 127.0.0.1:56876 2023-07-19 10:13:09,404 INFO [RS:0;jenkins-hbase4:35123] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 10:13:09,404 INFO [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(3305): Received CLOSE for e4b85c49b4add775223ef0908b5152fe 2023-07-19 10:13:09,404 DEBUG [RS:2;jenkins-hbase4:35869] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:09,404 INFO [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:13:09,407 INFO [RS:2;jenkins-hbase4:35869] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 10:13:09,407 INFO [RS:2;jenkins-hbase4:35869] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 10:13:09,407 DEBUG [RS:0;jenkins-hbase4:35123] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75adc386 to 127.0.0.1:56876 2023-07-19 10:13:09,407 INFO [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(3305): Received CLOSE for 60af2c5090478026d6317dcb9316d471 2023-07-19 10:13:09,407 INFO [RS:2;jenkins-hbase4:35869] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 10:13:09,407 INFO [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:13:09,408 INFO [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-19 10:13:09,408 DEBUG [RS:1;jenkins-hbase4:44313] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34925bcb to 127.0.0.1:56876 2023-07-19 10:13:09,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4b85c49b4add775223ef0908b5152fe, disabling compactions & flushes 2023-07-19 10:13:09,408 DEBUG [RS:1;jenkins-hbase4:44313] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:09,407 DEBUG [RS:0;jenkins-hbase4:35123] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:09,409 INFO [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 10:13:09,409 INFO [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35123,1689761420712; all regions closed. 2023-07-19 10:13:09,409 INFO [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-19 10:13:09,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. 2023-07-19 10:13:09,410 DEBUG [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(1478): Online Regions={e4b85c49b4add775223ef0908b5152fe=hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe., 60af2c5090478026d6317dcb9316d471=hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471.} 2023-07-19 10:13:09,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. 2023-07-19 10:13:09,409 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 10:13:09,409 DEBUG [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-19 10:13:09,410 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 10:13:09,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. after waiting 0 ms 2023-07-19 10:13:09,410 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 10:13:09,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. 2023-07-19 10:13:09,410 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 10:13:09,410 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 10:13:09,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e4b85c49b4add775223ef0908b5152fe 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-19 10:13:09,410 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-19 10:13:09,410 DEBUG [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(1504): Waiting on 60af2c5090478026d6317dcb9316d471, e4b85c49b4add775223ef0908b5152fe 2023-07-19 10:13:09,410 DEBUG [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-19 10:13:09,423 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 10:13:09,428 DEBUG [RS:0;jenkins-hbase4:35123] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/oldWALs 2023-07-19 10:13:09,428 INFO [RS:0;jenkins-hbase4:35123] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35123%2C1689761420712:(num 1689761423104) 2023-07-19 10:13:09,428 DEBUG [RS:0;jenkins-hbase4:35123] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:09,428 INFO [RS:0;jenkins-hbase4:35123] regionserver.LeaseManager(133): Closed leases 2023-07-19 10:13:09,431 INFO [RS:0;jenkins-hbase4:35123] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 10:13:09,431 INFO [RS:0;jenkins-hbase4:35123] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 10:13:09,431 INFO [RS:0;jenkins-hbase4:35123] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 10:13:09,431 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 10:13:09,431 INFO [RS:0;jenkins-hbase4:35123] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 10:13:09,434 INFO [RS:0;jenkins-hbase4:35123] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35123 2023-07-19 10:13:09,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/acl/e4b85c49b4add775223ef0908b5152fe/.tmp/l/d7309540f87e4211949aa71cd26b006e 2023-07-19 10:13:09,437 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 10:13:09,438 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/.tmp/info/c612933e1bb34c3499d54b88d4e84c1c 2023-07-19 10:13:09,442 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:13:09,442 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:13:09,442 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:13:09,442 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:13:09,442 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:13:09,442 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35123,1689761420712 2023-07-19 10:13:09,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d7309540f87e4211949aa71cd26b006e 2023-07-19 10:13:09,444 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:13:09,444 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c612933e1bb34c3499d54b88d4e84c1c 2023-07-19 10:13:09,444 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 10:13:09,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/acl/e4b85c49b4add775223ef0908b5152fe/.tmp/l/d7309540f87e4211949aa71cd26b006e as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/acl/e4b85c49b4add775223ef0908b5152fe/l/d7309540f87e4211949aa71cd26b006e 2023-07-19 10:13:09,445 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35123,1689761420712] 2023-07-19 10:13:09,446 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35123,1689761420712; numProcessing=1 2023-07-19 10:13:09,447 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35123,1689761420712 already deleted, retry=false 2023-07-19 10:13:09,447 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35123,1689761420712 expired; onlineServers=2 2023-07-19 10:13:09,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d7309540f87e4211949aa71cd26b006e 2023-07-19 10:13:09,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/acl/e4b85c49b4add775223ef0908b5152fe/l/d7309540f87e4211949aa71cd26b006e, entries=7, sequenceid=18, filesize=5.2 K 2023-07-19 10:13:09,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for e4b85c49b4add775223ef0908b5152fe in 41ms, sequenceid=18, compaction requested=false 2023-07-19 10:13:09,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/acl/e4b85c49b4add775223ef0908b5152fe/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-19 10:13:09,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:09,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. 2023-07-19 10:13:09,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4b85c49b4add775223ef0908b5152fe: 2023-07-19 10:13:09,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689761424486.e4b85c49b4add775223ef0908b5152fe. 2023-07-19 10:13:09,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 60af2c5090478026d6317dcb9316d471, disabling compactions & flushes 2023-07-19 10:13:09,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. 2023-07-19 10:13:09,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. 2023-07-19 10:13:09,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. after waiting 0 ms 2023-07-19 10:13:09,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. 2023-07-19 10:13:09,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 60af2c5090478026d6317dcb9316d471 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-19 10:13:09,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/namespace/60af2c5090478026d6317dcb9316d471/.tmp/info/c0910a652bcc414aa7d859a650f7aadb 2023-07-19 10:13:09,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/namespace/60af2c5090478026d6317dcb9316d471/.tmp/info/c0910a652bcc414aa7d859a650f7aadb as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/namespace/60af2c5090478026d6317dcb9316d471/info/c0910a652bcc414aa7d859a650f7aadb 2023-07-19 10:13:09,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/namespace/60af2c5090478026d6317dcb9316d471/info/c0910a652bcc414aa7d859a650f7aadb, entries=2, sequenceid=6, filesize=4.8 K 2023-07-19 10:13:09,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 60af2c5090478026d6317dcb9316d471 in 18ms, sequenceid=6, compaction requested=false 2023-07-19 10:13:09,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/namespace/60af2c5090478026d6317dcb9316d471/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:13:09,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:09,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. 2023-07-19 10:13:09,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 60af2c5090478026d6317dcb9316d471: 2023-07-19 10:13:09,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689761423611.60af2c5090478026d6317dcb9316d471. 2023-07-19 10:13:09,545 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:09,545 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35123-0x1017d0f8e620001, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:09,545 INFO [RS:0;jenkins-hbase4:35123] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35123,1689761420712; zookeeper connection closed. 2023-07-19 10:13:09,546 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@73d34a79] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@73d34a79 2023-07-19 10:13:09,611 INFO [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44313,1689761420775; all regions closed. 2023-07-19 10:13:09,611 DEBUG [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-19 10:13:09,617 DEBUG [RS:1;jenkins-hbase4:44313] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/oldWALs 2023-07-19 10:13:09,617 INFO [RS:1;jenkins-hbase4:44313] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44313%2C1689761420775:(num 1689761423105) 2023-07-19 10:13:09,617 DEBUG [RS:1;jenkins-hbase4:44313] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:09,617 INFO [RS:1;jenkins-hbase4:44313] regionserver.LeaseManager(133): Closed leases 2023-07-19 10:13:09,617 INFO [RS:1;jenkins-hbase4:44313] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 10:13:09,618 INFO [RS:1;jenkins-hbase4:44313] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 10:13:09,618 INFO [RS:1;jenkins-hbase4:44313] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 10:13:09,618 INFO [RS:1;jenkins-hbase4:44313] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 10:13:09,618 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 10:13:09,619 INFO [RS:1;jenkins-hbase4:44313] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44313 2023-07-19 10:13:09,620 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:13:09,620 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44313,1689761420775 2023-07-19 10:13:09,620 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:13:09,623 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44313,1689761420775] 2023-07-19 10:13:09,623 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44313,1689761420775; numProcessing=2 2023-07-19 10:13:09,625 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44313,1689761420775 already deleted, retry=false 2023-07-19 10:13:09,625 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44313,1689761420775 expired; onlineServers=1 2023-07-19 10:13:09,723 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:09,723 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:44313-0x1017d0f8e620002, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:09,723 INFO [RS:1;jenkins-hbase4:44313] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44313,1689761420775; zookeeper connection closed. 2023-07-19 10:13:09,724 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@449d05b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@449d05b 2023-07-19 10:13:09,811 DEBUG [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-19 10:13:09,858 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/.tmp/rep_barrier/0a6d097c8f7a453d83bca4d76074a175 2023-07-19 10:13:09,872 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a6d097c8f7a453d83bca4d76074a175 2023-07-19 10:13:09,897 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/.tmp/table/cba56f860e124ef5bf8a89b89fddce02 2023-07-19 10:13:09,911 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cba56f860e124ef5bf8a89b89fddce02 2023-07-19 10:13:09,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/.tmp/info/c612933e1bb34c3499d54b88d4e84c1c as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/info/c612933e1bb34c3499d54b88d4e84c1c 2023-07-19 10:13:09,919 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c612933e1bb34c3499d54b88d4e84c1c 2023-07-19 10:13:09,919 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/info/c612933e1bb34c3499d54b88d4e84c1c, entries=48, sequenceid=131, filesize=10.3 K 2023-07-19 10:13:09,920 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/.tmp/rep_barrier/0a6d097c8f7a453d83bca4d76074a175 as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/rep_barrier/0a6d097c8f7a453d83bca4d76074a175 2023-07-19 10:13:09,922 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-19 10:13:09,922 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-19 10:13:09,926 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a6d097c8f7a453d83bca4d76074a175 2023-07-19 10:13:09,926 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/rep_barrier/0a6d097c8f7a453d83bca4d76074a175, entries=13, sequenceid=131, filesize=6.4 K 2023-07-19 10:13:09,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/.tmp/table/cba56f860e124ef5bf8a89b89fddce02 as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/table/cba56f860e124ef5bf8a89b89fddce02 2023-07-19 10:13:09,933 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cba56f860e124ef5bf8a89b89fddce02 2023-07-19 10:13:09,933 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/table/cba56f860e124ef5bf8a89b89fddce02, entries=24, sequenceid=131, filesize=6.9 K 2023-07-19 10:13:09,934 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 524ms, sequenceid=131, compaction requested=false 2023-07-19 10:13:09,955 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-19 10:13:09,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:09,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 10:13:09,958 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 10:13:09,959 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 10:13:09,959 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-19 10:13:10,011 INFO [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35869,1689761420828; all regions closed. 2023-07-19 10:13:10,025 DEBUG [RS:2;jenkins-hbase4:35869] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/oldWALs 2023-07-19 10:13:10,025 INFO [RS:2;jenkins-hbase4:35869] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35869%2C1689761420828.meta:.meta(num 1689761423239) 2023-07-19 10:13:10,047 DEBUG [RS:2;jenkins-hbase4:35869] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/oldWALs 2023-07-19 10:13:10,047 INFO [RS:2;jenkins-hbase4:35869] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35869%2C1689761420828:(num 1689761423105) 2023-07-19 10:13:10,047 DEBUG [RS:2;jenkins-hbase4:35869] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:10,047 INFO [RS:2;jenkins-hbase4:35869] regionserver.LeaseManager(133): Closed leases 2023-07-19 10:13:10,048 INFO [RS:2;jenkins-hbase4:35869] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 10:13:10,048 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 10:13:10,050 INFO [RS:2;jenkins-hbase4:35869] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35869 2023-07-19 10:13:10,094 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:13:10,094 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35869,1689761420828 2023-07-19 10:13:10,098 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35869,1689761420828] 2023-07-19 10:13:10,098 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35869,1689761420828; numProcessing=3 2023-07-19 10:13:10,170 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35869,1689761420828 already deleted, retry=false 2023-07-19 10:13:10,170 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35869,1689761420828 expired; onlineServers=0 2023-07-19 10:13:10,171 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40385,1689761419057' ***** 2023-07-19 10:13:10,171 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-19 10:13:10,171 DEBUG [M:0;jenkins-hbase4:40385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3de2d950, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 10:13:10,171 INFO [M:0;jenkins-hbase4:40385] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40385,1689761419057 2023-07-19 10:13:10,171 INFO [M:0;jenkins-hbase4:40385] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40385,1689761419057; all regions closed. 2023-07-19 10:13:10,171 DEBUG [M:0;jenkins-hbase4:40385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:10,172 DEBUG [M:0;jenkins-hbase4:40385] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-19 10:13:10,172 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-19 10:13:10,172 DEBUG [M:0;jenkins-hbase4:40385] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-19 10:13:10,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689761422558] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689761422558,5,FailOnTimeoutGroup] 2023-07-19 10:13:10,172 INFO [M:0;jenkins-hbase4:40385] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-19 10:13:10,172 INFO [M:0;jenkins-hbase4:40385] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-19 10:13:10,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689761422576] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689761422576,5,FailOnTimeoutGroup] 2023-07-19 10:13:10,172 INFO [M:0;jenkins-hbase4:40385] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-19 10:13:10,172 DEBUG [M:0;jenkins-hbase4:40385] master.HMaster(1512): Stopping service threads 2023-07-19 10:13:10,173 INFO [M:0;jenkins-hbase4:40385] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-19 10:13:10,173 ERROR [M:0;jenkins-hbase4:40385] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-19 10:13:10,174 INFO [M:0;jenkins-hbase4:40385] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-19 10:13:10,174 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-19 10:13:10,226 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:10,226 INFO [RS:2;jenkins-hbase4:35869] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35869,1689761420828; zookeeper connection closed. 2023-07-19 10:13:10,226 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): regionserver:35869-0x1017d0f8e620003, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:10,226 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6c2a52b5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6c2a52b5 2023-07-19 10:13:10,227 INFO [Listener at jenkins-hbase4.apache.org/37821] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-19 10:13:10,247 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-19 10:13:10,247 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:13:10,247 DEBUG [M:0;jenkins-hbase4:40385] zookeeper.ZKUtil(398): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-19 10:13:10,247 WARN [M:0;jenkins-hbase4:40385] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-19 10:13:10,248 INFO [M:0;jenkins-hbase4:40385] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-19 10:13:10,248 INFO [M:0;jenkins-hbase4:40385] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-19 10:13:10,249 DEBUG [M:0;jenkins-hbase4:40385] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 10:13:10,249 INFO [M:0;jenkins-hbase4:40385] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:13:10,249 DEBUG [M:0;jenkins-hbase4:40385] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:13:10,249 DEBUG [M:0;jenkins-hbase4:40385] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 10:13:10,249 DEBUG [M:0;jenkins-hbase4:40385] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:13:10,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 10:13:10,249 INFO [M:0;jenkins-hbase4:40385] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.36 KB heapSize=449.55 KB 2023-07-19 10:13:10,327 INFO [M:0;jenkins-hbase4:40385] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.36 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a96bea40f8c442bbb7647126a3b7a1c9 2023-07-19 10:13:10,332 INFO [M:0;jenkins-hbase4:40385] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a96bea40f8c442bbb7647126a3b7a1c9 2023-07-19 10:13:10,333 DEBUG [M:0;jenkins-hbase4:40385] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a96bea40f8c442bbb7647126a3b7a1c9 as hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a96bea40f8c442bbb7647126a3b7a1c9 2023-07-19 10:13:10,340 INFO [M:0;jenkins-hbase4:40385] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a96bea40f8c442bbb7647126a3b7a1c9 2023-07-19 10:13:10,340 INFO [M:0;jenkins-hbase4:40385] regionserver.HStore(1080): Added hdfs://localhost:35157/user/jenkins/test-data/5c3376ce-88a3-7f00-cdd9-f64d736e15fc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a96bea40f8c442bbb7647126a3b7a1c9, entries=119, sequenceid=899, filesize=28.5 K 2023-07-19 10:13:10,341 INFO [M:0;jenkins-hbase4:40385] regionserver.HRegion(2948): Finished flush of dataSize ~373.36 KB/382316, heapSize ~449.53 KB/460320, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 92ms, sequenceid=899, compaction requested=false 2023-07-19 10:13:10,343 INFO [M:0;jenkins-hbase4:40385] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:13:10,343 DEBUG [M:0;jenkins-hbase4:40385] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 10:13:10,348 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 10:13:10,349 INFO [M:0;jenkins-hbase4:40385] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-19 10:13:10,350 INFO [M:0;jenkins-hbase4:40385] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40385 2023-07-19 10:13:10,351 DEBUG [M:0;jenkins-hbase4:40385] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40385,1689761419057 already deleted, retry=false 2023-07-19 10:13:10,455 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:10,456 INFO [M:0;jenkins-hbase4:40385] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40385,1689761419057; zookeeper connection closed. 2023-07-19 10:13:10,456 DEBUG [Listener at localhost/44891-EventThread] zookeeper.ZKWatcher(600): master:40385-0x1017d0f8e620000, quorum=127.0.0.1:56876, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:10,458 WARN [Listener at jenkins-hbase4.apache.org/37821] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 10:13:10,477 INFO [Listener at jenkins-hbase4.apache.org/37821] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 10:13:10,587 WARN [BP-782010573-172.31.14.131-1689761414590 heartbeating to localhost/127.0.0.1:35157] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 10:13:10,587 WARN [BP-782010573-172.31.14.131-1689761414590 heartbeating to localhost/127.0.0.1:35157] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-782010573-172.31.14.131-1689761414590 (Datanode Uuid 904c2d21-7cd4-4753-9903-19d6b751740f) service to localhost/127.0.0.1:35157 2023-07-19 10:13:10,589 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/dfs/data/data5/current/BP-782010573-172.31.14.131-1689761414590] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 10:13:10,589 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/dfs/data/data6/current/BP-782010573-172.31.14.131-1689761414590] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 10:13:10,593 WARN [Listener at jenkins-hbase4.apache.org/37821] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 10:13:10,628 INFO [Listener at jenkins-hbase4.apache.org/37821] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 10:13:10,732 WARN [BP-782010573-172.31.14.131-1689761414590 heartbeating to localhost/127.0.0.1:35157] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 10:13:10,733 WARN [BP-782010573-172.31.14.131-1689761414590 heartbeating to localhost/127.0.0.1:35157] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-782010573-172.31.14.131-1689761414590 (Datanode Uuid bb3c6a58-8e51-4733-9e9a-48cbe2a61752) service to localhost/127.0.0.1:35157 2023-07-19 10:13:10,733 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/dfs/data/data3/current/BP-782010573-172.31.14.131-1689761414590] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 10:13:10,734 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/dfs/data/data4/current/BP-782010573-172.31.14.131-1689761414590] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 10:13:10,736 WARN [Listener at jenkins-hbase4.apache.org/37821] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 10:13:10,743 INFO [Listener at jenkins-hbase4.apache.org/37821] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 10:13:10,847 WARN [BP-782010573-172.31.14.131-1689761414590 heartbeating to localhost/127.0.0.1:35157] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 10:13:10,847 WARN [BP-782010573-172.31.14.131-1689761414590 heartbeating to localhost/127.0.0.1:35157] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-782010573-172.31.14.131-1689761414590 (Datanode Uuid 5d09ee0b-5e3a-4f56-8b72-b333d5ead0d5) service to localhost/127.0.0.1:35157 2023-07-19 10:13:10,849 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/dfs/data/data1/current/BP-782010573-172.31.14.131-1689761414590] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 10:13:10,849 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/041495bb-bae2-1f78-972f-8822ac7a843c/cluster_1ef4895a-9c88-814c-bc0c-7a73391e6a32/dfs/data/data2/current/BP-782010573-172.31.14.131-1689761414590] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 10:13:10,885 INFO [Listener at jenkins-hbase4.apache.org/37821] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 10:13:10,935 INFO [Listener at jenkins-hbase4.apache.org/37821] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-19 10:13:11,031 INFO [Listener at jenkins-hbase4.apache.org/37821] hbase.HBaseTestingUtility(1293): Minicluster is down