2023-07-21 20:10:08,228 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-21 20:10:08,488 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd 2023-07-21 20:10:08,488 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-21 20:10:08,544 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-21 20:10:08,871 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-21 20:10:08,872 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6, deleteOnExit=true 2023-07-21 20:10:08,872 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-21 20:10:08,873 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/test.cache.data in system properties and HBase conf 2023-07-21 20:10:08,874 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop.tmp.dir in system properties and HBase conf 2023-07-21 20:10:08,874 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop.log.dir in system properties and HBase conf 2023-07-21 20:10:08,875 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-21 20:10:08,875 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-21 20:10:08,876 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-21 20:10:09,271 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-21 20:10:09,278 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-21 20:10:09,279 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-21 20:10:09,279 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-21 20:10:09,280 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 20:10:09,280 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-21 20:10:09,281 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-21 20:10:09,281 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 20:10:09,281 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 20:10:09,282 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-21 20:10:09,282 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/nfs.dump.dir in system properties and HBase conf 2023-07-21 20:10:09,283 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/java.io.tmpdir in system properties and HBase conf 2023-07-21 20:10:09,283 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 20:10:09,283 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-21 20:10:09,284 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-21 20:10:09,920 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 20:10:09,924 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 20:10:10,280 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-21 20:10:10,502 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-21 20:10:10,518 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:10,568 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:10,606 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/java.io.tmpdir/Jetty_localhost_33139_hdfs____vfsdk1/webapp 2023-07-21 20:10:10,782 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33139 2023-07-21 20:10:10,827 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 20:10:10,827 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 20:10:11,389 WARN [Listener at localhost/33875] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 20:10:11,508 WARN [Listener at localhost/33875] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 20:10:11,531 WARN [Listener at localhost/33875] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:11,540 INFO [Listener at localhost/33875] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:11,548 INFO [Listener at localhost/33875] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/java.io.tmpdir/Jetty_localhost_39417_datanode____.rtvylh/webapp 2023-07-21 20:10:11,684 INFO [Listener at localhost/33875] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39417 2023-07-21 20:10:12,237 WARN [Listener at localhost/44407] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 20:10:12,285 WARN [Listener at localhost/44407] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 20:10:12,290 WARN [Listener at localhost/44407] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:12,292 INFO [Listener at localhost/44407] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:12,307 INFO [Listener at localhost/44407] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/java.io.tmpdir/Jetty_localhost_39141_datanode____.rkbv81/webapp 2023-07-21 20:10:12,420 INFO [Listener at localhost/44407] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39141 2023-07-21 20:10:12,435 WARN [Listener at localhost/41291] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 20:10:12,483 WARN [Listener at localhost/41291] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 20:10:12,490 WARN [Listener at localhost/41291] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:12,493 INFO [Listener at localhost/41291] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:12,513 INFO [Listener at localhost/41291] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/java.io.tmpdir/Jetty_localhost_42331_datanode____.tx07ie/webapp 2023-07-21 20:10:12,669 INFO [Listener at localhost/41291] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42331 2023-07-21 20:10:12,697 WARN [Listener at localhost/35517] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 20:10:13,072 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x88cb0ddeb5fe718: Processing first storage report for DS-3edd2106-4b49-40ea-80b5-3433ca746a15 from datanode 79f0fc0d-0225-48fb-8dd9-bb207d95cd75 2023-07-21 20:10:13,075 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x88cb0ddeb5fe718: from storage DS-3edd2106-4b49-40ea-80b5-3433ca746a15 node DatanodeRegistration(127.0.0.1:34983, datanodeUuid=79f0fc0d-0225-48fb-8dd9-bb207d95cd75, infoPort=40545, infoSecurePort=0, ipcPort=35517, storageInfo=lv=-57;cid=testClusterID;nsid=1594792685;c=1689970210026), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-21 20:10:13,075 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x15d3d4d0475fb15: Processing first storage report for DS-0cf28e2c-d9cf-48b1-88be-ed6291c61092 from datanode aac4036e-5602-4c91-a2b8-e1c8cd691f28 2023-07-21 20:10:13,075 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x15d3d4d0475fb15: from storage DS-0cf28e2c-d9cf-48b1-88be-ed6291c61092 node DatanodeRegistration(127.0.0.1:40735, datanodeUuid=aac4036e-5602-4c91-a2b8-e1c8cd691f28, infoPort=41411, infoSecurePort=0, ipcPort=44407, storageInfo=lv=-57;cid=testClusterID;nsid=1594792685;c=1689970210026), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 20:10:13,075 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x92235c04cdadd952: Processing first storage report for DS-fe0f6f2d-1a23-41e4-9bed-b92f23052c5b from datanode 331c68a0-81aa-400f-a0c0-f1a987c842fa 2023-07-21 20:10:13,076 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x92235c04cdadd952: from storage DS-fe0f6f2d-1a23-41e4-9bed-b92f23052c5b node DatanodeRegistration(127.0.0.1:46731, datanodeUuid=331c68a0-81aa-400f-a0c0-f1a987c842fa, infoPort=39805, infoSecurePort=0, ipcPort=41291, storageInfo=lv=-57;cid=testClusterID;nsid=1594792685;c=1689970210026), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 20:10:13,076 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x88cb0ddeb5fe718: Processing first storage report for DS-c9ac099f-e1d5-4d78-af14-79e12074501f from datanode 79f0fc0d-0225-48fb-8dd9-bb207d95cd75 2023-07-21 20:10:13,076 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x88cb0ddeb5fe718: from storage DS-c9ac099f-e1d5-4d78-af14-79e12074501f node DatanodeRegistration(127.0.0.1:34983, datanodeUuid=79f0fc0d-0225-48fb-8dd9-bb207d95cd75, infoPort=40545, infoSecurePort=0, ipcPort=35517, storageInfo=lv=-57;cid=testClusterID;nsid=1594792685;c=1689970210026), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 20:10:13,076 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x15d3d4d0475fb15: Processing first storage report for DS-b64d8405-5f60-4d48-bb76-c1ecc281b7e2 from datanode aac4036e-5602-4c91-a2b8-e1c8cd691f28 2023-07-21 20:10:13,076 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x15d3d4d0475fb15: from storage DS-b64d8405-5f60-4d48-bb76-c1ecc281b7e2 node DatanodeRegistration(127.0.0.1:40735, datanodeUuid=aac4036e-5602-4c91-a2b8-e1c8cd691f28, infoPort=41411, infoSecurePort=0, ipcPort=44407, storageInfo=lv=-57;cid=testClusterID;nsid=1594792685;c=1689970210026), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-21 20:10:13,077 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x92235c04cdadd952: Processing first storage report for DS-026ba9e4-dd35-4542-b0c8-5359e87735c8 from datanode 331c68a0-81aa-400f-a0c0-f1a987c842fa 2023-07-21 20:10:13,077 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x92235c04cdadd952: from storage DS-026ba9e4-dd35-4542-b0c8-5359e87735c8 node DatanodeRegistration(127.0.0.1:46731, datanodeUuid=331c68a0-81aa-400f-a0c0-f1a987c842fa, infoPort=39805, infoSecurePort=0, ipcPort=41291, storageInfo=lv=-57;cid=testClusterID;nsid=1594792685;c=1689970210026), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 20:10:13,332 DEBUG [Listener at localhost/35517] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd 2023-07-21 20:10:13,443 INFO [Listener at localhost/35517] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/zookeeper_0, clientPort=57298, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-21 20:10:13,465 INFO [Listener at localhost/35517] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57298 2023-07-21 20:10:13,477 INFO [Listener at localhost/35517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:13,480 INFO [Listener at localhost/35517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:14,170 INFO [Listener at localhost/35517] util.FSUtils(471): Created version file at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 with version=8 2023-07-21 20:10:14,170 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/hbase-staging 2023-07-21 20:10:14,553 INFO [Listener at localhost/35517] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-21 20:10:15,210 INFO [Listener at localhost/35517] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 20:10:15,244 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:15,244 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:15,245 INFO [Listener at localhost/35517] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 20:10:15,245 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:15,245 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 20:10:15,395 INFO [Listener at localhost/35517] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 20:10:15,496 DEBUG [Listener at localhost/35517] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-21 20:10:15,632 INFO [Listener at localhost/35517] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34903 2023-07-21 20:10:15,651 INFO [Listener at localhost/35517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:15,654 INFO [Listener at localhost/35517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:15,686 INFO [Listener at localhost/35517] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34903 connecting to ZooKeeper ensemble=127.0.0.1:57298 2023-07-21 20:10:15,771 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:349030x0, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 20:10:15,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34903-0x101898185290000 connected 2023-07-21 20:10:15,826 DEBUG [Listener at localhost/35517] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 20:10:15,827 DEBUG [Listener at localhost/35517] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:10:15,845 DEBUG [Listener at localhost/35517] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 20:10:15,858 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34903 2023-07-21 20:10:15,859 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34903 2023-07-21 20:10:15,864 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34903 2023-07-21 20:10:15,869 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34903 2023-07-21 20:10:15,869 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34903 2023-07-21 20:10:15,876 INFO [Listener at localhost/35517] master.HMaster(444): hbase.rootdir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091, hbase.cluster.distributed=false 2023-07-21 20:10:15,969 INFO [Listener at localhost/35517] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 20:10:15,969 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:15,970 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:15,970 INFO [Listener at localhost/35517] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 20:10:15,970 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:15,970 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 20:10:15,976 INFO [Listener at localhost/35517] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 20:10:15,979 INFO [Listener at localhost/35517] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39241 2023-07-21 20:10:15,982 INFO [Listener at localhost/35517] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 20:10:16,004 DEBUG [Listener at localhost/35517] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-21 20:10:16,005 INFO [Listener at localhost/35517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:16,008 INFO [Listener at localhost/35517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:16,011 INFO [Listener at localhost/35517] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39241 connecting to ZooKeeper ensemble=127.0.0.1:57298 2023-07-21 20:10:16,017 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:392410x0, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 20:10:16,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39241-0x101898185290001 connected 2023-07-21 20:10:16,019 DEBUG [Listener at localhost/35517] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 20:10:16,021 DEBUG [Listener at localhost/35517] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:10:16,022 DEBUG [Listener at localhost/35517] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 20:10:16,026 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39241 2023-07-21 20:10:16,026 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39241 2023-07-21 20:10:16,027 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39241 2023-07-21 20:10:16,029 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39241 2023-07-21 20:10:16,029 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39241 2023-07-21 20:10:16,045 INFO [Listener at localhost/35517] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 20:10:16,045 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:16,046 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:16,046 INFO [Listener at localhost/35517] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 20:10:16,047 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:16,047 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 20:10:16,047 INFO [Listener at localhost/35517] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 20:10:16,049 INFO [Listener at localhost/35517] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45843 2023-07-21 20:10:16,049 INFO [Listener at localhost/35517] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 20:10:16,051 DEBUG [Listener at localhost/35517] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-21 20:10:16,052 INFO [Listener at localhost/35517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:16,055 INFO [Listener at localhost/35517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:16,057 INFO [Listener at localhost/35517] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45843 connecting to ZooKeeper ensemble=127.0.0.1:57298 2023-07-21 20:10:16,067 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:458430x0, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 20:10:16,068 DEBUG [Listener at localhost/35517] zookeeper.ZKUtil(164): regionserver:458430x0, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 20:10:16,069 DEBUG [Listener at localhost/35517] zookeeper.ZKUtil(164): regionserver:458430x0, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:10:16,071 DEBUG [Listener at localhost/35517] zookeeper.ZKUtil(164): regionserver:458430x0, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 20:10:16,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45843-0x101898185290002 connected 2023-07-21 20:10:16,072 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45843 2023-07-21 20:10:16,072 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45843 2023-07-21 20:10:16,078 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45843 2023-07-21 20:10:16,081 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45843 2023-07-21 20:10:16,081 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45843 2023-07-21 20:10:16,100 INFO [Listener at localhost/35517] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 20:10:16,100 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:16,101 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:16,101 INFO [Listener at localhost/35517] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 20:10:16,101 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 20:10:16,101 INFO [Listener at localhost/35517] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 20:10:16,101 INFO [Listener at localhost/35517] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 20:10:16,103 INFO [Listener at localhost/35517] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38477 2023-07-21 20:10:16,104 INFO [Listener at localhost/35517] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 20:10:16,105 DEBUG [Listener at localhost/35517] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-21 20:10:16,106 INFO [Listener at localhost/35517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:16,108 INFO [Listener at localhost/35517] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:16,109 INFO [Listener at localhost/35517] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38477 connecting to ZooKeeper ensemble=127.0.0.1:57298 2023-07-21 20:10:16,121 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:384770x0, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 20:10:16,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38477-0x101898185290003 connected 2023-07-21 20:10:16,123 DEBUG [Listener at localhost/35517] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 20:10:16,124 DEBUG [Listener at localhost/35517] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:10:16,125 DEBUG [Listener at localhost/35517] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 20:10:16,131 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38477 2023-07-21 20:10:16,131 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38477 2023-07-21 20:10:16,132 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38477 2023-07-21 20:10:16,134 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38477 2023-07-21 20:10:16,134 DEBUG [Listener at localhost/35517] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38477 2023-07-21 20:10:16,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34903,1689970214352 2023-07-21 20:10:16,147 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 20:10:16,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34903,1689970214352 2023-07-21 20:10:16,173 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 20:10:16,173 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 20:10:16,173 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 20:10:16,174 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:16,173 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 20:10:16,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 20:10:16,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 20:10:16,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34903,1689970214352 from backup master directory 2023-07-21 20:10:16,185 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34903,1689970214352 2023-07-21 20:10:16,185 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 20:10:16,186 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 20:10:16,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34903,1689970214352 2023-07-21 20:10:16,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-21 20:10:16,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-21 20:10:16,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/hbase.id with ID: f7e18f01-f328-440d-b6db-3afa818923e1 2023-07-21 20:10:16,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 20:10:16,440 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:16,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x533b692b to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:16,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d875dd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:16,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 20:10:16,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-21 20:10:16,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-21 20:10:16,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-21 20:10:16,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 20:10:16,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 20:10:16,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 20:10:16,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/MasterData/data/master/store-tmp 2023-07-21 20:10:16,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:16,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 20:10:16,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:10:16,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:10:16,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 20:10:16,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:10:16,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:10:16,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 20:10:16,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/MasterData/WALs/jenkins-hbase4.apache.org,34903,1689970214352 2023-07-21 20:10:16,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34903%2C1689970214352, suffix=, logDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/MasterData/WALs/jenkins-hbase4.apache.org,34903,1689970214352, archiveDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/MasterData/oldWALs, maxLogs=10 2023-07-21 20:10:16,836 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34983,DS-3edd2106-4b49-40ea-80b5-3433ca746a15,DISK] 2023-07-21 20:10:16,844 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40735,DS-0cf28e2c-d9cf-48b1-88be-ed6291c61092,DISK] 2023-07-21 20:10:16,836 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46731,DS-fe0f6f2d-1a23-41e4-9bed-b92f23052c5b,DISK] 2023-07-21 20:10:16,853 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-21 20:10:16,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/MasterData/WALs/jenkins-hbase4.apache.org,34903,1689970214352/jenkins-hbase4.apache.org%2C34903%2C1689970214352.1689970216753 2023-07-21 20:10:16,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46731,DS-fe0f6f2d-1a23-41e4-9bed-b92f23052c5b,DISK], DatanodeInfoWithStorage[127.0.0.1:40735,DS-0cf28e2c-d9cf-48b1-88be-ed6291c61092,DISK], DatanodeInfoWithStorage[127.0.0.1:34983,DS-3edd2106-4b49-40ea-80b5-3433ca746a15,DISK]] 2023-07-21 20:10:16,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-21 20:10:16,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:16,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 20:10:16,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 20:10:17,067 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-21 20:10:17,076 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-21 20:10:17,103 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-21 20:10:17,116 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:17,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 20:10:17,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 20:10:17,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 20:10:17,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:17,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60363715, jitterRate=-0.10051055252552032}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:17,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 20:10:17,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-21 20:10:17,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-21 20:10:17,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-21 20:10:17,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-21 20:10:17,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-21 20:10:17,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-07-21 20:10:17,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-21 20:10:17,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-21 20:10:17,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-21 20:10:17,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-21 20:10:17,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-21 20:10:17,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-21 20:10:17,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-21 20:10:17,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-21 20:10:17,334 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:17,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-21 20:10:17,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-21 20:10:17,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-21 20:10:17,361 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 20:10:17,361 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 20:10:17,361 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 20:10:17,361 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 20:10:17,361 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:17,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34903,1689970214352, sessionid=0x101898185290000, setting cluster-up flag (Was=false) 2023-07-21 20:10:17,382 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:17,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-21 20:10:17,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34903,1689970214352 2023-07-21 20:10:17,397 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:17,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-21 20:10:17,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34903,1689970214352 2023-07-21 20:10:17,408 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp 2023-07-21 20:10:17,450 INFO [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(951): ClusterId : f7e18f01-f328-440d-b6db-3afa818923e1 2023-07-21 20:10:17,450 INFO [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(951): ClusterId : f7e18f01-f328-440d-b6db-3afa818923e1 2023-07-21 20:10:17,452 INFO [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(951): ClusterId : f7e18f01-f328-440d-b6db-3afa818923e1 2023-07-21 20:10:17,463 DEBUG [RS:1;jenkins-hbase4:45843] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 20:10:17,463 DEBUG [RS:2;jenkins-hbase4:38477] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 20:10:17,463 DEBUG [RS:0;jenkins-hbase4:39241] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 20:10:17,470 DEBUG [RS:0;jenkins-hbase4:39241] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 20:10:17,470 DEBUG [RS:1;jenkins-hbase4:45843] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 20:10:17,470 DEBUG [RS:2;jenkins-hbase4:38477] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 20:10:17,470 DEBUG [RS:1;jenkins-hbase4:45843] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 20:10:17,470 DEBUG [RS:0;jenkins-hbase4:39241] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 20:10:17,470 DEBUG [RS:2;jenkins-hbase4:38477] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 20:10:17,477 DEBUG [RS:2;jenkins-hbase4:38477] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 20:10:17,478 DEBUG [RS:1;jenkins-hbase4:45843] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 20:10:17,479 DEBUG [RS:2;jenkins-hbase4:38477] zookeeper.ReadOnlyZKClient(139): Connect 0x42c5d4b5 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:17,480 DEBUG [RS:1;jenkins-hbase4:45843] zookeeper.ReadOnlyZKClient(139): Connect 0x34dacc17 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:17,481 DEBUG [RS:0;jenkins-hbase4:39241] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 20:10:17,496 DEBUG [RS:0;jenkins-hbase4:39241] zookeeper.ReadOnlyZKClient(139): Connect 0x7c83ded0 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:17,542 DEBUG [RS:2;jenkins-hbase4:38477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c02229d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:17,543 DEBUG [RS:2;jenkins-hbase4:38477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@483dbfc5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 20:10:17,546 DEBUG [RS:1;jenkins-hbase4:45843] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a1d34fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:17,547 DEBUG [RS:1;jenkins-hbase4:45843] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e22a767, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 20:10:17,551 DEBUG [RS:0;jenkins-hbase4:39241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72442f30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:17,551 DEBUG [RS:0;jenkins-hbase4:39241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@767bb5a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 20:10:17,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-21 20:10:17,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:17,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-21 20:10:17,581 DEBUG [RS:0;jenkins-hbase4:39241] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39241 2023-07-21 20:10:17,584 DEBUG [RS:1;jenkins-hbase4:45843] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45843 2023-07-21 20:10:17,589 INFO [RS:0;jenkins-hbase4:39241] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 20:10:17,589 INFO [RS:0;jenkins-hbase4:39241] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 20:10:17,589 DEBUG [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 20:10:17,591 INFO [RS:1;jenkins-hbase4:45843] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 20:10:17,595 INFO [RS:1;jenkins-hbase4:45843] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 20:10:17,595 DEBUG [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 20:10:17,595 INFO [RS:0;jenkins-hbase4:39241] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:17,595 INFO [RS:1;jenkins-hbase4:45843] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:17,599 DEBUG [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 20:10:17,599 DEBUG [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 20:10:17,603 INFO [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34903,1689970214352 with isa=jenkins-hbase4.apache.org/172.31.14.131:45843, startcode=1689970216044 2023-07-21 20:10:17,608 INFO [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34903,1689970214352 with isa=jenkins-hbase4.apache.org/172.31.14.131:39241, startcode=1689970215968 2023-07-21 20:10:17,612 DEBUG [RS:2;jenkins-hbase4:38477] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:38477 2023-07-21 20:10:17,612 INFO [RS:2;jenkins-hbase4:38477] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 20:10:17,612 INFO [RS:2;jenkins-hbase4:38477] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 20:10:17,612 DEBUG [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 20:10:17,612 INFO [RS:2;jenkins-hbase4:38477] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:17,612 DEBUG [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 20:10:17,614 INFO [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34903,1689970214352 with isa=jenkins-hbase4.apache.org/172.31.14.131:38477, startcode=1689970216099 2023-07-21 20:10:17,629 DEBUG [RS:0;jenkins-hbase4:39241] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 20:10:17,629 DEBUG [RS:2;jenkins-hbase4:38477] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 20:10:17,633 DEBUG [RS:1;jenkins-hbase4:45843] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 20:10:17,741 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35437, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 20:10:17,741 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46997, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 20:10:17,742 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55187, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 20:10:17,753 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34903] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 20:10:17,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-21 20:10:17,764 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34903] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 20:10:17,768 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34903] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 20:10:17,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 20:10:17,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 20:10:17,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 20:10:17,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 20:10:17,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-21 20:10:17,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:17,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 20:10:17,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:17,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689970247783 2023-07-21 20:10:17,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-21 20:10:17,791 DEBUG [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 20:10:17,791 WARN [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 20:10:17,792 DEBUG [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 20:10:17,792 DEBUG [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 20:10:17,792 WARN [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 20:10:17,792 WARN [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 20:10:17,796 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 20:10:17,796 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-21 20:10:17,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-21 20:10:17,801 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 20:10:17,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-21 20:10:17,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-21 20:10:17,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-21 20:10:17,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-21 20:10:17,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:17,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-21 20:10:17,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-21 20:10:17,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-21 20:10:17,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-21 20:10:17,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-21 20:10:17,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689970217820,5,FailOnTimeoutGroup] 2023-07-21 20:10:17,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689970217820,5,FailOnTimeoutGroup] 2023-07-21 20:10:17,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:17,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-21 20:10:17,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:17,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:17,862 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 20:10:17,864 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 20:10:17,864 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:10:17,894 INFO [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34903,1689970214352 with isa=jenkins-hbase4.apache.org/172.31.14.131:45843, startcode=1689970216044 2023-07-21 20:10:17,895 INFO [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34903,1689970214352 with isa=jenkins-hbase4.apache.org/172.31.14.131:38477, startcode=1689970216099 2023-07-21 20:10:17,895 INFO [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34903,1689970214352 with isa=jenkins-hbase4.apache.org/172.31.14.131:39241, startcode=1689970215968 2023-07-21 20:10:17,917 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34903] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:17,926 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:17,926 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34903] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:17,928 DEBUG [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:10:17,929 DEBUG [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33875 2023-07-21 20:10:17,929 DEBUG [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 20:10:17,930 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34903] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:17,931 DEBUG [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:10:17,931 DEBUG [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33875 2023-07-21 20:10:17,931 DEBUG [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 20:10:17,932 DEBUG [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:10:17,932 DEBUG [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33875 2023-07-21 20:10:17,933 DEBUG [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 20:10:17,933 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 20:10:17,943 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 20:10:17,948 DEBUG [RS:1;jenkins-hbase4:45843] zookeeper.ZKUtil(162): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:17,949 DEBUG [RS:0;jenkins-hbase4:39241] zookeeper.ZKUtil(162): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:17,948 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/info 2023-07-21 20:10:17,950 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38477,1689970216099] 2023-07-21 20:10:17,950 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39241,1689970215968] 2023-07-21 20:10:17,950 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45843,1689970216044] 2023-07-21 20:10:17,948 DEBUG [RS:2;jenkins-hbase4:38477] zookeeper.ZKUtil(162): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:17,950 WARN [RS:0;jenkins-hbase4:39241] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 20:10:17,949 WARN [RS:1;jenkins-hbase4:45843] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 20:10:17,951 INFO [RS:0;jenkins-hbase4:39241] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 20:10:17,951 WARN [RS:2;jenkins-hbase4:38477] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 20:10:17,951 DEBUG [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/WALs/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:17,951 INFO [RS:2;jenkins-hbase4:38477] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 20:10:17,952 DEBUG [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/WALs/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:17,951 INFO [RS:1;jenkins-hbase4:45843] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 20:10:17,952 DEBUG [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/WALs/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:17,955 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 20:10:17,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:17,969 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 20:10:17,972 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/rep_barrier 2023-07-21 20:10:17,974 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 20:10:17,976 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:17,977 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 20:10:17,979 DEBUG [RS:0;jenkins-hbase4:39241] zookeeper.ZKUtil(162): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:17,979 DEBUG [RS:1;jenkins-hbase4:45843] zookeeper.ZKUtil(162): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:17,979 DEBUG [RS:2;jenkins-hbase4:38477] zookeeper.ZKUtil(162): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:17,980 DEBUG [RS:0;jenkins-hbase4:39241] zookeeper.ZKUtil(162): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:17,980 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/table 2023-07-21 20:10:17,980 DEBUG [RS:1;jenkins-hbase4:45843] zookeeper.ZKUtil(162): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:17,980 DEBUG [RS:2;jenkins-hbase4:38477] zookeeper.ZKUtil(162): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:17,980 DEBUG [RS:0;jenkins-hbase4:39241] zookeeper.ZKUtil(162): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:17,981 DEBUG [RS:1;jenkins-hbase4:45843] zookeeper.ZKUtil(162): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:17,981 DEBUG [RS:2;jenkins-hbase4:38477] zookeeper.ZKUtil(162): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:17,981 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 20:10:17,982 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:17,985 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740 2023-07-21 20:10:17,986 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740 2023-07-21 20:10:17,991 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 20:10:17,994 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 20:10:17,998 DEBUG [RS:1;jenkins-hbase4:45843] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 20:10:17,998 DEBUG [RS:2;jenkins-hbase4:38477] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 20:10:17,998 DEBUG [RS:0;jenkins-hbase4:39241] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 20:10:18,004 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:18,005 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72815398, jitterRate=0.08503398299217224}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 20:10:18,006 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 20:10:18,006 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 20:10:18,006 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 20:10:18,006 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 20:10:18,006 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 20:10:18,006 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 20:10:18,007 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 20:10:18,008 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 20:10:18,015 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 20:10:18,015 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-21 20:10:18,019 INFO [RS:0;jenkins-hbase4:39241] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 20:10:18,019 INFO [RS:2;jenkins-hbase4:38477] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 20:10:18,020 INFO [RS:1;jenkins-hbase4:45843] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 20:10:18,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-21 20:10:18,049 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-21 20:10:18,061 INFO [RS:0;jenkins-hbase4:39241] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 20:10:18,067 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-21 20:10:18,067 INFO [RS:2;jenkins-hbase4:38477] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 20:10:18,073 INFO [RS:1;jenkins-hbase4:45843] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 20:10:18,090 INFO [RS:0;jenkins-hbase4:39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 20:10:18,090 INFO [RS:0;jenkins-hbase4:39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,091 INFO [RS:2;jenkins-hbase4:38477] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 20:10:18,097 INFO [RS:2;jenkins-hbase4:38477] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,106 INFO [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 20:10:18,106 INFO [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 20:10:18,114 INFO [RS:1;jenkins-hbase4:45843] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 20:10:18,114 INFO [RS:1;jenkins-hbase4:45843] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,122 INFO [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 20:10:18,125 INFO [RS:0;jenkins-hbase4:39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,125 INFO [RS:1;jenkins-hbase4:45843] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,126 DEBUG [RS:0;jenkins-hbase4:39241] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,126 DEBUG [RS:0;jenkins-hbase4:39241] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,126 DEBUG [RS:0;jenkins-hbase4:39241] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,126 DEBUG [RS:0;jenkins-hbase4:39241] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,126 DEBUG [RS:0;jenkins-hbase4:39241] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,127 DEBUG [RS:0;jenkins-hbase4:39241] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 20:10:18,127 DEBUG [RS:0;jenkins-hbase4:39241] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,127 DEBUG [RS:0;jenkins-hbase4:39241] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,126 DEBUG [RS:1;jenkins-hbase4:45843] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,128 DEBUG [RS:0;jenkins-hbase4:39241] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,128 DEBUG [RS:1;jenkins-hbase4:45843] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,128 DEBUG [RS:0;jenkins-hbase4:39241] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,128 INFO [RS:2;jenkins-hbase4:38477] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,128 DEBUG [RS:1;jenkins-hbase4:45843] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,129 DEBUG [RS:2;jenkins-hbase4:38477] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,129 DEBUG [RS:1;jenkins-hbase4:45843] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,129 DEBUG [RS:2;jenkins-hbase4:38477] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,129 DEBUG [RS:1;jenkins-hbase4:45843] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,129 DEBUG [RS:2;jenkins-hbase4:38477] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,129 DEBUG [RS:1;jenkins-hbase4:45843] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 20:10:18,129 DEBUG [RS:2;jenkins-hbase4:38477] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,129 DEBUG [RS:1;jenkins-hbase4:45843] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,129 DEBUG [RS:2;jenkins-hbase4:38477] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,129 DEBUG [RS:1;jenkins-hbase4:45843] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,130 DEBUG [RS:2;jenkins-hbase4:38477] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 20:10:18,130 DEBUG [RS:1;jenkins-hbase4:45843] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,130 DEBUG [RS:2;jenkins-hbase4:38477] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,130 DEBUG [RS:1;jenkins-hbase4:45843] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,130 DEBUG [RS:2;jenkins-hbase4:38477] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,130 DEBUG [RS:2;jenkins-hbase4:38477] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,130 DEBUG [RS:2;jenkins-hbase4:38477] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 20:10:18,135 INFO [RS:0;jenkins-hbase4:39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,150 INFO [RS:2;jenkins-hbase4:38477] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,151 INFO [RS:2;jenkins-hbase4:38477] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,151 INFO [RS:2;jenkins-hbase4:38477] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,151 INFO [RS:0;jenkins-hbase4:39241] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,151 INFO [RS:0;jenkins-hbase4:39241] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,187 INFO [RS:1;jenkins-hbase4:45843] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,187 INFO [RS:1;jenkins-hbase4:45843] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,187 INFO [RS:1;jenkins-hbase4:45843] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,196 INFO [RS:2;jenkins-hbase4:38477] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 20:10:18,220 INFO [RS:0;jenkins-hbase4:39241] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 20:10:18,223 INFO [RS:2;jenkins-hbase4:38477] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38477,1689970216099-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,223 INFO [RS:0;jenkins-hbase4:39241] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39241,1689970215968-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,228 INFO [RS:1;jenkins-hbase4:45843] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 20:10:18,229 INFO [RS:1;jenkins-hbase4:45843] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45843,1689970216044-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:18,237 DEBUG [jenkins-hbase4:34903] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-21 20:10:18,243 DEBUG [jenkins-hbase4:34903] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:10:18,271 DEBUG [jenkins-hbase4:34903] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:10:18,272 DEBUG [jenkins-hbase4:34903] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:10:18,272 DEBUG [jenkins-hbase4:34903] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:10:18,272 DEBUG [jenkins-hbase4:34903] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:10:18,291 INFO [RS:0;jenkins-hbase4:39241] regionserver.Replication(203): jenkins-hbase4.apache.org,39241,1689970215968 started 2023-07-21 20:10:18,292 INFO [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39241,1689970215968, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39241, sessionid=0x101898185290001 2023-07-21 20:10:18,292 DEBUG [RS:0;jenkins-hbase4:39241] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 20:10:18,292 DEBUG [RS:0;jenkins-hbase4:39241] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:18,292 DEBUG [RS:0;jenkins-hbase4:39241] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39241,1689970215968' 2023-07-21 20:10:18,292 DEBUG [RS:0;jenkins-hbase4:39241] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 20:10:18,294 DEBUG [RS:0;jenkins-hbase4:39241] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 20:10:18,295 DEBUG [RS:0;jenkins-hbase4:39241] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 20:10:18,295 DEBUG [RS:0;jenkins-hbase4:39241] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 20:10:18,295 DEBUG [RS:0;jenkins-hbase4:39241] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:18,295 DEBUG [RS:0;jenkins-hbase4:39241] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39241,1689970215968' 2023-07-21 20:10:18,295 DEBUG [RS:0;jenkins-hbase4:39241] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:18,296 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45843,1689970216044, state=OPENING 2023-07-21 20:10:18,297 DEBUG [RS:0;jenkins-hbase4:39241] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:18,298 DEBUG [RS:0;jenkins-hbase4:39241] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 20:10:18,298 INFO [RS:0;jenkins-hbase4:39241] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 20:10:18,298 INFO [RS:0;jenkins-hbase4:39241] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 20:10:18,302 INFO [RS:2;jenkins-hbase4:38477] regionserver.Replication(203): jenkins-hbase4.apache.org,38477,1689970216099 started 2023-07-21 20:10:18,303 INFO [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38477,1689970216099, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38477, sessionid=0x101898185290003 2023-07-21 20:10:18,303 DEBUG [RS:2;jenkins-hbase4:38477] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 20:10:18,303 DEBUG [RS:2;jenkins-hbase4:38477] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:18,306 DEBUG [RS:2;jenkins-hbase4:38477] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38477,1689970216099' 2023-07-21 20:10:18,307 DEBUG [RS:2;jenkins-hbase4:38477] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 20:10:18,309 DEBUG [RS:2;jenkins-hbase4:38477] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 20:10:18,311 DEBUG [RS:2;jenkins-hbase4:38477] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 20:10:18,311 DEBUG [RS:2;jenkins-hbase4:38477] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 20:10:18,311 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-21 20:10:18,311 DEBUG [RS:2;jenkins-hbase4:38477] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:18,312 DEBUG [RS:2;jenkins-hbase4:38477] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38477,1689970216099' 2023-07-21 20:10:18,312 DEBUG [RS:2;jenkins-hbase4:38477] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:18,314 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:18,314 DEBUG [RS:2;jenkins-hbase4:38477] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:18,315 DEBUG [RS:2;jenkins-hbase4:38477] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 20:10:18,315 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 20:10:18,315 INFO [RS:2;jenkins-hbase4:38477] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 20:10:18,323 INFO [RS:1;jenkins-hbase4:45843] regionserver.Replication(203): jenkins-hbase4.apache.org,45843,1689970216044 started 2023-07-21 20:10:18,324 INFO [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45843,1689970216044, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45843, sessionid=0x101898185290002 2023-07-21 20:10:18,323 INFO [RS:2;jenkins-hbase4:38477] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 20:10:18,324 DEBUG [RS:1;jenkins-hbase4:45843] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 20:10:18,324 DEBUG [RS:1;jenkins-hbase4:45843] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:18,324 DEBUG [RS:1;jenkins-hbase4:45843] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45843,1689970216044' 2023-07-21 20:10:18,324 DEBUG [RS:1;jenkins-hbase4:45843] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 20:10:18,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45843,1689970216044}] 2023-07-21 20:10:18,329 DEBUG [RS:1;jenkins-hbase4:45843] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 20:10:18,330 DEBUG [RS:1;jenkins-hbase4:45843] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 20:10:18,330 DEBUG [RS:1;jenkins-hbase4:45843] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 20:10:18,330 DEBUG [RS:1;jenkins-hbase4:45843] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:18,330 DEBUG [RS:1;jenkins-hbase4:45843] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45843,1689970216044' 2023-07-21 20:10:18,330 DEBUG [RS:1;jenkins-hbase4:45843] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:18,331 DEBUG [RS:1;jenkins-hbase4:45843] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:18,331 DEBUG [RS:1;jenkins-hbase4:45843] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 20:10:18,331 INFO [RS:1;jenkins-hbase4:45843] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 20:10:18,331 INFO [RS:1;jenkins-hbase4:45843] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 20:10:18,414 INFO [RS:0;jenkins-hbase4:39241] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39241%2C1689970215968, suffix=, logDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/WALs/jenkins-hbase4.apache.org,39241,1689970215968, archiveDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/oldWALs, maxLogs=32 2023-07-21 20:10:18,428 INFO [RS:2;jenkins-hbase4:38477] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38477%2C1689970216099, suffix=, logDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/WALs/jenkins-hbase4.apache.org,38477,1689970216099, archiveDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/oldWALs, maxLogs=32 2023-07-21 20:10:18,435 INFO [RS:1;jenkins-hbase4:45843] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45843%2C1689970216044, suffix=, logDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/WALs/jenkins-hbase4.apache.org,45843,1689970216044, archiveDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/oldWALs, maxLogs=32 2023-07-21 20:10:18,483 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40735,DS-0cf28e2c-d9cf-48b1-88be-ed6291c61092,DISK] 2023-07-21 20:10:18,485 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46731,DS-fe0f6f2d-1a23-41e4-9bed-b92f23052c5b,DISK] 2023-07-21 20:10:18,487 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34983,DS-3edd2106-4b49-40ea-80b5-3433ca746a15,DISK] 2023-07-21 20:10:18,529 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40735,DS-0cf28e2c-d9cf-48b1-88be-ed6291c61092,DISK] 2023-07-21 20:10:18,530 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46731,DS-fe0f6f2d-1a23-41e4-9bed-b92f23052c5b,DISK] 2023-07-21 20:10:18,530 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34983,DS-3edd2106-4b49-40ea-80b5-3433ca746a15,DISK] 2023-07-21 20:10:18,549 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40735,DS-0cf28e2c-d9cf-48b1-88be-ed6291c61092,DISK] 2023-07-21 20:10:18,550 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46731,DS-fe0f6f2d-1a23-41e4-9bed-b92f23052c5b,DISK] 2023-07-21 20:10:18,551 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34983,DS-3edd2106-4b49-40ea-80b5-3433ca746a15,DISK] 2023-07-21 20:10:18,564 INFO [RS:0;jenkins-hbase4:39241] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/WALs/jenkins-hbase4.apache.org,39241,1689970215968/jenkins-hbase4.apache.org%2C39241%2C1689970215968.1689970218419 2023-07-21 20:10:18,590 DEBUG [RS:0;jenkins-hbase4:39241] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40735,DS-0cf28e2c-d9cf-48b1-88be-ed6291c61092,DISK], DatanodeInfoWithStorage[127.0.0.1:34983,DS-3edd2106-4b49-40ea-80b5-3433ca746a15,DISK], DatanodeInfoWithStorage[127.0.0.1:46731,DS-fe0f6f2d-1a23-41e4-9bed-b92f23052c5b,DISK]] 2023-07-21 20:10:18,595 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:18,603 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 20:10:18,611 INFO [RS:2;jenkins-hbase4:38477] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/WALs/jenkins-hbase4.apache.org,38477,1689970216099/jenkins-hbase4.apache.org%2C38477%2C1689970216099.1689970218431 2023-07-21 20:10:18,619 DEBUG [RS:2;jenkins-hbase4:38477] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46731,DS-fe0f6f2d-1a23-41e4-9bed-b92f23052c5b,DISK], DatanodeInfoWithStorage[127.0.0.1:34983,DS-3edd2106-4b49-40ea-80b5-3433ca746a15,DISK], DatanodeInfoWithStorage[127.0.0.1:40735,DS-0cf28e2c-d9cf-48b1-88be-ed6291c61092,DISK]] 2023-07-21 20:10:18,621 INFO [RS:1;jenkins-hbase4:45843] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/WALs/jenkins-hbase4.apache.org,45843,1689970216044/jenkins-hbase4.apache.org%2C45843%2C1689970216044.1689970218437 2023-07-21 20:10:18,634 DEBUG [RS:1;jenkins-hbase4:45843] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46731,DS-fe0f6f2d-1a23-41e4-9bed-b92f23052c5b,DISK], DatanodeInfoWithStorage[127.0.0.1:40735,DS-0cf28e2c-d9cf-48b1-88be-ed6291c61092,DISK], DatanodeInfoWithStorage[127.0.0.1:34983,DS-3edd2106-4b49-40ea-80b5-3433ca746a15,DISK]] 2023-07-21 20:10:18,647 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 20:10:18,683 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-21 20:10:18,683 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 20:10:18,688 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45843%2C1689970216044.meta, suffix=.meta, logDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/WALs/jenkins-hbase4.apache.org,45843,1689970216044, archiveDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/oldWALs, maxLogs=32 2023-07-21 20:10:18,722 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46731,DS-fe0f6f2d-1a23-41e4-9bed-b92f23052c5b,DISK] 2023-07-21 20:10:18,734 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40735,DS-0cf28e2c-d9cf-48b1-88be-ed6291c61092,DISK] 2023-07-21 20:10:18,737 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34983,DS-3edd2106-4b49-40ea-80b5-3433ca746a15,DISK] 2023-07-21 20:10:18,750 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/WALs/jenkins-hbase4.apache.org,45843,1689970216044/jenkins-hbase4.apache.org%2C45843%2C1689970216044.meta.1689970218691.meta 2023-07-21 20:10:18,752 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46731,DS-fe0f6f2d-1a23-41e4-9bed-b92f23052c5b,DISK], DatanodeInfoWithStorage[127.0.0.1:40735,DS-0cf28e2c-d9cf-48b1-88be-ed6291c61092,DISK], DatanodeInfoWithStorage[127.0.0.1:34983,DS-3edd2106-4b49-40ea-80b5-3433ca746a15,DISK]] 2023-07-21 20:10:18,753 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-21 20:10:18,755 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-21 20:10:18,757 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:18,758 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-21 20:10:18,761 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-21 20:10:18,763 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-21 20:10:18,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-21 20:10:18,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:18,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-21 20:10:18,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-21 20:10:18,794 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 20:10:18,796 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/info 2023-07-21 20:10:18,797 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/info 2023-07-21 20:10:18,798 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 20:10:18,802 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:18,802 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 20:10:18,804 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/rep_barrier 2023-07-21 20:10:18,804 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/rep_barrier 2023-07-21 20:10:18,805 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 20:10:18,806 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:18,806 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 20:10:18,808 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/table 2023-07-21 20:10:18,808 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/table 2023-07-21 20:10:18,809 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 20:10:18,810 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:18,812 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740 2023-07-21 20:10:18,816 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740 2023-07-21 20:10:18,823 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 20:10:18,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 20:10:18,828 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60353174, jitterRate=-0.10066762566566467}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 20:10:18,832 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 20:10:18,851 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689970218581 2023-07-21 20:10:18,890 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45843,1689970216044, state=OPEN 2023-07-21 20:10:18,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-21 20:10:18,894 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-21 20:10:18,895 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-21 20:10:18,895 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 20:10:18,904 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-21 20:10:18,904 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45843,1689970216044 in 570 msec 2023-07-21 20:10:18,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-21 20:10:18,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 879 msec 2023-07-21 20:10:18,917 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3260 sec 2023-07-21 20:10:18,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689970218918, completionTime=-1 2023-07-21 20:10:18,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-21 20:10:18,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-21 20:10:19,044 DEBUG [hconnection-0x25caca0a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:19,047 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:19,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-21 20:10:19,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689970279078 2023-07-21 20:10:19,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689970339078 2023-07-21 20:10:19,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 160 msec 2023-07-21 20:10:19,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34903,1689970214352-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:19,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34903,1689970214352-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:19,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34903,1689970214352-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:19,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34903, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:19,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-21 20:10:19,132 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-21 20:10:19,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-21 20:10:19,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 20:10:19,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-21 20:10:19,147 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:10:19,151 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:10:19,175 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/hbase/namespace/ee8dbcb045a2834910cab769353baf79 2023-07-21 20:10:19,179 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/hbase/namespace/ee8dbcb045a2834910cab769353baf79 empty. 2023-07-21 20:10:19,180 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/hbase/namespace/ee8dbcb045a2834910cab769353baf79 2023-07-21 20:10:19,180 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-21 20:10:19,234 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-21 20:10:19,237 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => ee8dbcb045a2834910cab769353baf79, NAME => 'hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:10:19,256 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:19,256 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing ee8dbcb045a2834910cab769353baf79, disabling compactions & flushes 2023-07-21 20:10:19,256 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. 2023-07-21 20:10:19,256 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. 2023-07-21 20:10:19,256 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. after waiting 0 ms 2023-07-21 20:10:19,256 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. 2023-07-21 20:10:19,256 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. 2023-07-21 20:10:19,256 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for ee8dbcb045a2834910cab769353baf79: 2023-07-21 20:10:19,263 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:10:19,279 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689970219266"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970219266"}]},"ts":"1689970219266"} 2023-07-21 20:10:19,312 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 20:10:19,314 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:10:19,319 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970219315"}]},"ts":"1689970219315"} 2023-07-21 20:10:19,361 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-21 20:10:19,367 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:10:19,368 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:10:19,369 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:10:19,369 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:10:19,369 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:10:19,372 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ee8dbcb045a2834910cab769353baf79, ASSIGN}] 2023-07-21 20:10:19,376 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ee8dbcb045a2834910cab769353baf79, ASSIGN 2023-07-21 20:10:19,377 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ee8dbcb045a2834910cab769353baf79, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39241,1689970215968; forceNewPlan=false, retain=false 2023-07-21 20:10:19,530 INFO [jenkins-hbase4:34903] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 20:10:19,531 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ee8dbcb045a2834910cab769353baf79, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:19,532 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689970219531"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970219531"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970219531"}]},"ts":"1689970219531"} 2023-07-21 20:10:19,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ee8dbcb045a2834910cab769353baf79, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:10:19,692 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:19,692 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 20:10:19,697 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 20:10:19,703 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. 2023-07-21 20:10:19,703 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ee8dbcb045a2834910cab769353baf79, NAME => 'hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79.', STARTKEY => '', ENDKEY => ''} 2023-07-21 20:10:19,704 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. service=AccessControlService 2023-07-21 20:10:19,705 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:19,705 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ee8dbcb045a2834910cab769353baf79 2023-07-21 20:10:19,705 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:19,706 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ee8dbcb045a2834910cab769353baf79 2023-07-21 20:10:19,706 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ee8dbcb045a2834910cab769353baf79 2023-07-21 20:10:19,708 INFO [StoreOpener-ee8dbcb045a2834910cab769353baf79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ee8dbcb045a2834910cab769353baf79 2023-07-21 20:10:19,710 DEBUG [StoreOpener-ee8dbcb045a2834910cab769353baf79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/namespace/ee8dbcb045a2834910cab769353baf79/info 2023-07-21 20:10:19,710 DEBUG [StoreOpener-ee8dbcb045a2834910cab769353baf79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/namespace/ee8dbcb045a2834910cab769353baf79/info 2023-07-21 20:10:19,711 INFO [StoreOpener-ee8dbcb045a2834910cab769353baf79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ee8dbcb045a2834910cab769353baf79 columnFamilyName info 2023-07-21 20:10:19,712 INFO [StoreOpener-ee8dbcb045a2834910cab769353baf79-1] regionserver.HStore(310): Store=ee8dbcb045a2834910cab769353baf79/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:19,714 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/namespace/ee8dbcb045a2834910cab769353baf79 2023-07-21 20:10:19,715 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/namespace/ee8dbcb045a2834910cab769353baf79 2023-07-21 20:10:19,719 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ee8dbcb045a2834910cab769353baf79 2023-07-21 20:10:19,723 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/namespace/ee8dbcb045a2834910cab769353baf79/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:19,724 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ee8dbcb045a2834910cab769353baf79; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69973895, jitterRate=0.042692288756370544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:19,724 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ee8dbcb045a2834910cab769353baf79: 2023-07-21 20:10:19,726 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79., pid=6, masterSystemTime=1689970219692 2023-07-21 20:10:19,731 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. 2023-07-21 20:10:19,731 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. 2023-07-21 20:10:19,733 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ee8dbcb045a2834910cab769353baf79, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:19,733 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689970219732"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970219732"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970219732"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970219732"}]},"ts":"1689970219732"} 2023-07-21 20:10:19,740 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-21 20:10:19,740 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ee8dbcb045a2834910cab769353baf79, server=jenkins-hbase4.apache.org,39241,1689970215968 in 200 msec 2023-07-21 20:10:19,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-21 20:10:19,744 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ee8dbcb045a2834910cab769353baf79, ASSIGN in 368 msec 2023-07-21 20:10:19,745 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:10:19,745 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970219745"}]},"ts":"1689970219745"} 2023-07-21 20:10:19,747 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-21 20:10:19,751 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:10:19,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-21 20:10:19,754 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-21 20:10:19,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 616 msec 2023-07-21 20:10:19,754 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:19,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:19,780 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:19,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-21 20:10:19,814 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 20:10:19,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-07-21 20:10:19,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-21 20:10:19,840 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 20:10:19,847 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-21 20:10:19,856 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-21 20:10:19,859 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-21 20:10:19,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.673sec 2023-07-21 20:10:19,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-21 20:10:19,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-21 20:10:19,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-21 20:10:19,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34903,1689970214352-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-21 20:10:19,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34903,1689970214352-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-21 20:10:19,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 20:10:19,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-21 20:10:19,900 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:10:19,902 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:10:19,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-21 20:10:19,906 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/hbase/acl/23b50f045f5f10b3590cd91ddb56138f 2023-07-21 20:10:19,908 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/hbase/acl/23b50f045f5f10b3590cd91ddb56138f empty. 2023-07-21 20:10:19,911 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/hbase/acl/23b50f045f5f10b3590cd91ddb56138f 2023-07-21 20:10:19,911 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-21 20:10:19,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 20:10:19,953 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-21 20:10:19,956 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 23b50f045f5f10b3590cd91ddb56138f, NAME => 'hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:10:19,962 DEBUG [Listener at localhost/35517] zookeeper.ReadOnlyZKClient(139): Connect 0x7ae320dd to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:19,983 DEBUG [Listener at localhost/35517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71692184, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:20,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 20:10:20,034 DEBUG [hconnection-0x2fa98406-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:20,058 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:20,061 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34903,1689970214352 2023-07-21 20:10:20,061 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-21 20:10:20,061 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/test.cache.data in system properties and HBase conf 2023-07-21 20:10:20,062 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop.tmp.dir in system properties and HBase conf 2023-07-21 20:10:20,062 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop.log.dir in system properties and HBase conf 2023-07-21 20:10:20,062 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-21 20:10:20,062 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-21 20:10:20,062 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-21 20:10:20,062 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-21 20:10:20,062 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-21 20:10:20,063 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-21 20:10:20,063 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 20:10:20,063 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-21 20:10:20,063 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-21 20:10:20,063 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 20:10:20,063 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 20:10:20,063 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-21 20:10:20,063 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/nfs.dump.dir in system properties and HBase conf 2023-07-21 20:10:20,063 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/java.io.tmpdir in system properties and HBase conf 2023-07-21 20:10:20,064 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 20:10:20,064 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-21 20:10:20,064 INFO [Listener at localhost/35517] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-21 20:10:20,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 20:10:20,450 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:20,450 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 23b50f045f5f10b3590cd91ddb56138f, disabling compactions & flushes 2023-07-21 20:10:20,450 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. 2023-07-21 20:10:20,450 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. 2023-07-21 20:10:20,451 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. after waiting 0 ms 2023-07-21 20:10:20,451 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. 2023-07-21 20:10:20,451 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. 2023-07-21 20:10:20,451 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 23b50f045f5f10b3590cd91ddb56138f: 2023-07-21 20:10:20,457 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:10:20,460 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689970220460"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970220460"}]},"ts":"1689970220460"} 2023-07-21 20:10:20,464 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 20:10:20,466 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:10:20,466 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970220466"}]},"ts":"1689970220466"} 2023-07-21 20:10:20,469 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-21 20:10:20,474 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:10:20,476 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:10:20,476 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:10:20,476 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:10:20,477 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:10:20,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=23b50f045f5f10b3590cd91ddb56138f, ASSIGN}] 2023-07-21 20:10:20,482 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=23b50f045f5f10b3590cd91ddb56138f, ASSIGN 2023-07-21 20:10:20,489 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=23b50f045f5f10b3590cd91ddb56138f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39241,1689970215968; forceNewPlan=false, retain=false 2023-07-21 20:10:20,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 20:10:20,639 INFO [jenkins-hbase4:34903] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 20:10:20,640 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=23b50f045f5f10b3590cd91ddb56138f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:20,641 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689970220640"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970220640"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970220640"}]},"ts":"1689970220640"} 2023-07-21 20:10:20,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 23b50f045f5f10b3590cd91ddb56138f, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:10:20,813 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. 2023-07-21 20:10:20,813 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 23b50f045f5f10b3590cd91ddb56138f, NAME => 'hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f.', STARTKEY => '', ENDKEY => ''} 2023-07-21 20:10:20,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. service=AccessControlService 2023-07-21 20:10:20,814 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:20,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 23b50f045f5f10b3590cd91ddb56138f 2023-07-21 20:10:20,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:20,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 23b50f045f5f10b3590cd91ddb56138f 2023-07-21 20:10:20,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 23b50f045f5f10b3590cd91ddb56138f 2023-07-21 20:10:20,833 INFO [StoreOpener-23b50f045f5f10b3590cd91ddb56138f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 23b50f045f5f10b3590cd91ddb56138f 2023-07-21 20:10:20,837 DEBUG [StoreOpener-23b50f045f5f10b3590cd91ddb56138f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/acl/23b50f045f5f10b3590cd91ddb56138f/l 2023-07-21 20:10:20,837 DEBUG [StoreOpener-23b50f045f5f10b3590cd91ddb56138f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/acl/23b50f045f5f10b3590cd91ddb56138f/l 2023-07-21 20:10:20,837 INFO [StoreOpener-23b50f045f5f10b3590cd91ddb56138f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23b50f045f5f10b3590cd91ddb56138f columnFamilyName l 2023-07-21 20:10:20,838 INFO [StoreOpener-23b50f045f5f10b3590cd91ddb56138f-1] regionserver.HStore(310): Store=23b50f045f5f10b3590cd91ddb56138f/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:20,841 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/acl/23b50f045f5f10b3590cd91ddb56138f 2023-07-21 20:10:20,842 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/acl/23b50f045f5f10b3590cd91ddb56138f 2023-07-21 20:10:20,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 23b50f045f5f10b3590cd91ddb56138f 2023-07-21 20:10:20,853 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/acl/23b50f045f5f10b3590cd91ddb56138f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:20,854 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 23b50f045f5f10b3590cd91ddb56138f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67687614, jitterRate=0.008624047040939331}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:20,855 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 23b50f045f5f10b3590cd91ddb56138f: 2023-07-21 20:10:20,856 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f., pid=11, masterSystemTime=1689970220801 2023-07-21 20:10:20,859 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. 2023-07-21 20:10:20,859 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. 2023-07-21 20:10:20,863 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=23b50f045f5f10b3590cd91ddb56138f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:20,863 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689970220862"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970220862"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970220862"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970220862"}]},"ts":"1689970220862"} 2023-07-21 20:10:20,870 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-21 20:10:20,870 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 23b50f045f5f10b3590cd91ddb56138f, server=jenkins-hbase4.apache.org,39241,1689970215968 in 220 msec 2023-07-21 20:10:20,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-21 20:10:20,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=23b50f045f5f10b3590cd91ddb56138f, ASSIGN in 393 msec 2023-07-21 20:10:20,875 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:10:20,875 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970220875"}]},"ts":"1689970220875"} 2023-07-21 20:10:20,877 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-21 20:10:20,880 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:10:20,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 985 msec 2023-07-21 20:10:21,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 20:10:21,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-21 20:10:21,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-21 20:10:21,486 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:21,885 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:21,895 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45027_jobhistory____.dgnatf/webapp 2023-07-21 20:10:22,086 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-21 20:10:22,086 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-21 20:10:22,086 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 20:10:22,090 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 20:10:22,182 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:22,544 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:23,053 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-21 20:10:23,138 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45027 2023-07-21 20:10:24,348 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:10:24,642 WARN [Listener at jenkins-hbase4.apache.org/42141] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:24,680 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-21 20:10:24,682 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-21 20:10:24,683 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-21 20:10:24,684 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:10:24,685 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-21 20:10:24,686 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:10:24,686 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-21 20:10:24,686 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 20:10:24,686 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-21 20:10:24,686 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:10:24,686 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-21 20:10:24,686 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 20:10:24,687 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-21 20:10:24,766 WARN [Listener at jenkins-hbase4.apache.org/42141] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 20:10:24,767 INFO [Listener at jenkins-hbase4.apache.org/42141] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:24,777 INFO [Listener at jenkins-hbase4.apache.org/42141] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43979_cluster____mo27mw/webapp 2023-07-21 20:10:24,875 INFO [Listener at jenkins-hbase4.apache.org/42141] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 20:10:24,875 INFO [Listener at jenkins-hbase4.apache.org/42141] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-21 20:10:24,875 INFO [Listener at jenkins-hbase4.apache.org/42141] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 20:10:24,876 INFO [Listener at jenkins-hbase4.apache.org/42141] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 20:10:24,890 INFO [Listener at jenkins-hbase4.apache.org/42141] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:25,143 INFO [Listener at jenkins-hbase4.apache.org/42141] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:25,271 INFO [Listener at jenkins-hbase4.apache.org/42141] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:25,283 INFO [Listener at jenkins-hbase4.apache.org/42141] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43979 2023-07-21 20:10:25,763 WARN [Listener at jenkins-hbase4.apache.org/35705] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:25,788 WARN [Listener at jenkins-hbase4.apache.org/35705] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 20:10:25,789 INFO [Listener at jenkins-hbase4.apache.org/35705] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:25,796 INFO [Listener at jenkins-hbase4.apache.org/35705] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38035_node____.jegqt1/webapp 2023-07-21 20:10:25,862 INFO [Listener at jenkins-hbase4.apache.org/35705] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-21 20:10:25,862 INFO [Listener at jenkins-hbase4.apache.org/35705] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 20:10:25,862 INFO [Listener at jenkins-hbase4.apache.org/35705] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 20:10:25,862 INFO [Listener at jenkins-hbase4.apache.org/35705] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 20:10:25,875 INFO [Listener at jenkins-hbase4.apache.org/35705] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:25,901 INFO [Listener at jenkins-hbase4.apache.org/35705] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:25,999 INFO [Listener at jenkins-hbase4.apache.org/35705] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:26,012 INFO [Listener at jenkins-hbase4.apache.org/35705] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38035 2023-07-21 20:10:26,248 WARN [Listener at jenkins-hbase4.apache.org/33191] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 20:10:26,255 WARN [Listener at jenkins-hbase4.apache.org/33191] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 20:10:26,255 INFO [Listener at jenkins-hbase4.apache.org/33191] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 20:10:26,264 INFO [Listener at jenkins-hbase4.apache.org/33191] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38615_node____lvpxg3/webapp 2023-07-21 20:10:26,324 INFO [Listener at jenkins-hbase4.apache.org/33191] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-21 20:10:26,324 INFO [Listener at jenkins-hbase4.apache.org/33191] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 20:10:26,324 INFO [Listener at jenkins-hbase4.apache.org/33191] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 20:10:26,324 INFO [Listener at jenkins-hbase4.apache.org/33191] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 20:10:26,332 INFO [Listener at jenkins-hbase4.apache.org/33191] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:26,349 INFO [Listener at jenkins-hbase4.apache.org/33191] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:26,442 INFO [Listener at jenkins-hbase4.apache.org/33191] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 20:10:26,451 INFO [Listener at jenkins-hbase4.apache.org/33191] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38615 2023-07-21 20:10:26,492 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-21 20:10:26,493 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:10:26,570 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=711, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=179, AvailableMemoryMB=9360 2023-07-21 20:10:26,571 WARN [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(130): Thread=711 is superior to 500 2023-07-21 20:10:26,587 DEBUG [Listener at jenkins-hbase4.apache.org/33191] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 20:10:26,593 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-21 20:10:26,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 20:10:26,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:26,611 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:10:26,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-21 20:10:26,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 20:10:26,614 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:10:26,619 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138 2023-07-21 20:10:26,619 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c 2023-07-21 20:10:26,620 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c empty. 2023-07-21 20:10:26,622 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c 2023-07-21 20:10:26,623 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138 empty. 2023-07-21 20:10:26,625 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138 2023-07-21 20:10:26,625 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-21 20:10:26,664 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-21 20:10:26,665 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 759d8825784f8d336958b919ea11e138, NAME => 'testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:10:26,665 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 450788d3f724be40f90d567e00e5f98c, NAME => 'testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:10:26,703 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:26,703 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 450788d3f724be40f90d567e00e5f98c, disabling compactions & flushes 2023-07-21 20:10:26,703 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:26,703 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:26,703 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. after waiting 0 ms 2023-07-21 20:10:26,703 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:26,703 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:26,703 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 450788d3f724be40f90d567e00e5f98c: 2023-07-21 20:10:26,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 20:10:26,724 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:26,724 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 759d8825784f8d336958b919ea11e138, disabling compactions & flushes 2023-07-21 20:10:26,724 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:26,724 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:26,724 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. after waiting 0 ms 2023-07-21 20:10:26,724 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:26,724 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:26,724 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 759d8825784f8d336958b919ea11e138: 2023-07-21 20:10:26,729 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:10:26,732 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970226731"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970226731"}]},"ts":"1689970226731"} 2023-07-21 20:10:26,732 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970226731"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970226731"}]},"ts":"1689970226731"} 2023-07-21 20:10:26,787 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:10:26,789 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:10:26,789 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970226789"}]},"ts":"1689970226789"} 2023-07-21 20:10:26,791 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-21 20:10:26,796 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:10:26,799 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:10:26,799 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:10:26,799 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:10:26,799 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:10:26,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759d8825784f8d336958b919ea11e138, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=450788d3f724be40f90d567e00e5f98c, ASSIGN}] 2023-07-21 20:10:26,802 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=450788d3f724be40f90d567e00e5f98c, ASSIGN 2023-07-21 20:10:26,802 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759d8825784f8d336958b919ea11e138, ASSIGN 2023-07-21 20:10:26,804 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759d8825784f8d336958b919ea11e138, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45843,1689970216044; forceNewPlan=false, retain=false 2023-07-21 20:10:26,804 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=450788d3f724be40f90d567e00e5f98c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39241,1689970215968; forceNewPlan=false, retain=false 2023-07-21 20:10:26,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 20:10:26,955 INFO [jenkins-hbase4:34903] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:10:26,957 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=450788d3f724be40f90d567e00e5f98c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:26,957 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=759d8825784f8d336958b919ea11e138, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:26,957 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970226957"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970226957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970226957"}]},"ts":"1689970226957"} 2023-07-21 20:10:26,957 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970226957"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970226957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970226957"}]},"ts":"1689970226957"} 2023-07-21 20:10:26,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 450788d3f724be40f90d567e00e5f98c, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:10:26,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 759d8825784f8d336958b919ea11e138, server=jenkins-hbase4.apache.org,45843,1689970216044}] 2023-07-21 20:10:27,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:27,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:27,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 759d8825784f8d336958b919ea11e138, NAME => 'testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 20:10:27,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 450788d3f724be40f90d567e00e5f98c, NAME => 'testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 20:10:27,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. service=AccessControlService 2023-07-21 20:10:27,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. service=AccessControlService 2023-07-21 20:10:27,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:27,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:27,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 759d8825784f8d336958b919ea11e138 2023-07-21 20:10:27,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 450788d3f724be40f90d567e00e5f98c 2023-07-21 20:10:27,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:27,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:27,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 759d8825784f8d336958b919ea11e138 2023-07-21 20:10:27,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 450788d3f724be40f90d567e00e5f98c 2023-07-21 20:10:27,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 759d8825784f8d336958b919ea11e138 2023-07-21 20:10:27,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 450788d3f724be40f90d567e00e5f98c 2023-07-21 20:10:27,139 INFO [StoreOpener-759d8825784f8d336958b919ea11e138-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 759d8825784f8d336958b919ea11e138 2023-07-21 20:10:27,144 INFO [StoreOpener-450788d3f724be40f90d567e00e5f98c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 450788d3f724be40f90d567e00e5f98c 2023-07-21 20:10:27,146 DEBUG [StoreOpener-759d8825784f8d336958b919ea11e138-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/cf 2023-07-21 20:10:27,146 DEBUG [StoreOpener-759d8825784f8d336958b919ea11e138-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/cf 2023-07-21 20:10:27,147 INFO [StoreOpener-759d8825784f8d336958b919ea11e138-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 759d8825784f8d336958b919ea11e138 columnFamilyName cf 2023-07-21 20:10:27,147 DEBUG [StoreOpener-450788d3f724be40f90d567e00e5f98c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/cf 2023-07-21 20:10:27,147 DEBUG [StoreOpener-450788d3f724be40f90d567e00e5f98c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/cf 2023-07-21 20:10:27,148 INFO [StoreOpener-450788d3f724be40f90d567e00e5f98c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 450788d3f724be40f90d567e00e5f98c columnFamilyName cf 2023-07-21 20:10:27,148 INFO [StoreOpener-759d8825784f8d336958b919ea11e138-1] regionserver.HStore(310): Store=759d8825784f8d336958b919ea11e138/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:27,150 INFO [StoreOpener-450788d3f724be40f90d567e00e5f98c-1] regionserver.HStore(310): Store=450788d3f724be40f90d567e00e5f98c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:27,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138 2023-07-21 20:10:27,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138 2023-07-21 20:10:27,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c 2023-07-21 20:10:27,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c 2023-07-21 20:10:27,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 759d8825784f8d336958b919ea11e138 2023-07-21 20:10:27,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 450788d3f724be40f90d567e00e5f98c 2023-07-21 20:10:27,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:27,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 759d8825784f8d336958b919ea11e138; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64683001, jitterRate=-0.03614817559719086}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:27,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 759d8825784f8d336958b919ea11e138: 2023-07-21 20:10:27,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138., pid=16, masterSystemTime=1689970227119 2023-07-21 20:10:27,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:27,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 450788d3f724be40f90d567e00e5f98c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66750097, jitterRate=-0.005346044898033142}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:27,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 450788d3f724be40f90d567e00e5f98c: 2023-07-21 20:10:27,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c., pid=15, masterSystemTime=1689970227119 2023-07-21 20:10:27,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:27,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:27,190 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=759d8825784f8d336958b919ea11e138, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:27,190 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970227190"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970227190"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970227190"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970227190"}]},"ts":"1689970227190"} 2023-07-21 20:10:27,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:27,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:27,195 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=450788d3f724be40f90d567e00e5f98c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:27,197 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970227195"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970227195"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970227195"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970227195"}]},"ts":"1689970227195"} 2023-07-21 20:10:27,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-21 20:10:27,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 759d8825784f8d336958b919ea11e138, server=jenkins-hbase4.apache.org,45843,1689970216044 in 232 msec 2023-07-21 20:10:27,205 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759d8825784f8d336958b919ea11e138, ASSIGN in 402 msec 2023-07-21 20:10:27,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-21 20:10:27,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 450788d3f724be40f90d567e00e5f98c, server=jenkins-hbase4.apache.org,39241,1689970215968 in 239 msec 2023-07-21 20:10:27,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-21 20:10:27,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=450788d3f724be40f90d567e00e5f98c, ASSIGN in 408 msec 2023-07-21 20:10:27,212 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:10:27,212 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970227212"}]},"ts":"1689970227212"} 2023-07-21 20:10:27,214 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-21 20:10:27,217 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:10:27,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 20:10:27,223 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-21 20:10:27,233 DEBUG [hconnection-0x1d7c3b11-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:27,237 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-21 20:10:27,246 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 20:10:27,287 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:27,287 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:27,287 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:27,287 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:10:27,288 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:27,297 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:27,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:27,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 695 msec 2023-07-21 20:10:27,302 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:27,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:27,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 20:10:27,722 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-21 20:10:27,723 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-21 20:10:27,724 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:10:27,729 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-21 20:10:27,730 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:10:27,730 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-21 20:10:27,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 20:10:27,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970227751 (current time:1689970227751). 2023-07-21 20:10:27,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:10:27,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x219e8e23 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:27,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ad6de4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:27,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:27,767 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:27,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x219e8e23 to 127.0.0.1:57298 2023-07-21 20:10:27,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:27,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x32aa23bf to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:27,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42c10583, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:27,784 DEBUG [hconnection-0x1f06a5a6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:27,785 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:27,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:27,794 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:27,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32aa23bf to 127.0.0.1:57298 2023-07-21 20:10:27,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:27,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 20:10:27,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:10:27,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 20:10:27,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 20:10:27,856 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 20:10:27,857 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689970827857 2023-07-21 20:10:27,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 20:10:27,857 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-21 20:10:27,861 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 20:10:27,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 20:10:27,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-21 20:10:27,866 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 20:10:27,866 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:10:27,866 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:10:27,867 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689970827867 2023-07-21 20:10:27,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,901 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-21 20:10:27,901 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:27,902 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-21 20:10:27,902 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-21 20:10:27,903 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,903 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,908 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:27,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:27,908 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:27,909 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:27,909 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,909 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:27,909 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:27,909 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:27,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:27,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:27,909 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:10:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 20:10:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 20:10:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,912 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 20:10:27,912 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 20:10:27,915 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,916 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 20:10:27,916 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 20:10:27,916 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:27,916 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:27,917 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 20:10:27,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,919 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 20:10:27,919 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 20:10:27,919 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 20:10:27,919 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 20:10:27,919 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 20:10:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 20:10:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,920 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 20:10:27,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,921 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 20:10:27,921 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:27,922 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 20:10:27,922 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 20:10:27,922 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 20:10:27,922 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:27,922 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:27,923 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:27,923 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,923 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:27,923 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:27,929 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,930 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,930 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:27,930 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,930 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:27,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:27,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:27,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:27,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-21 20:10:27,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48f8ecfc[Count = 1] remaining members to acquire global barrier 2023-07-21 20:10:27,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:27,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:27,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:27,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:27,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:27,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:27,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:27,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:27,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:27,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-21 20:10:27,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48f8ecfc[Count = 0] remaining members to acquire global barrier 2023-07-21 20:10:27,937 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-21 20:10:27,937 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,940 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,940 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,940 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,941 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 20:10:27,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,941 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:27,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,941 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 20:10:27,941 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 20:10:27,941 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 20:10:27,941 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38477,1689970216099' in zk 2023-07-21 20:10:27,941 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:27,941 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:10:27,948 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 20:10:27,948 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:27,948 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 20:10:27,950 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:27,950 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:27,957 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:27,958 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. started... 2023-07-21 20:10:27,962 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:27,964 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:27,964 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:27,964 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. started... 2023-07-21 20:10:27,966 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:27,966 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 450788d3f724be40f90d567e00e5f98c: 2023-07-21 20:10:27,966 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 759d8825784f8d336958b919ea11e138: 2023-07-21 20:10:27,968 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,968 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:27,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 20:10:27,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:27,972 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:10:27,974 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:27,974 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:27,980 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:10:27,980 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:10:28,043 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. completed. 2023-07-21 20:10:28,043 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:28,044 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:28,044 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:28,044 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,044 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 20:10:28,044 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. completed. 2023-07-21 20:10:28,044 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39241,1689970215968' in zk 2023-07-21 20:10:28,044 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:28,044 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:28,045 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:28,045 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,045 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 20:10:28,045 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45843,1689970216044' in zk 2023-07-21 20:10:28,046 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,046 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 20:10:28,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,047 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:28,047 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 20:10:28,049 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 20:10:28,049 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,049 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:28,049 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 20:10:28,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39241,1689970215968': 2023-07-21 20:10:28,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-21 20:10:28,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45843,1689970216044': 2023-07-21 20:10:28,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-21 20:10:28,061 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-21 20:10:28,061 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:10:28,061 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:10:28,061 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,061 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:10:28,064 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,064 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,065 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,064 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,064 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,065 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,065 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,066 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,066 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,067 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,070 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,071 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,071 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,088 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,088 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,088 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,089 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:28,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,088 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,088 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,088 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,088 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,090 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,090 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,090 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,090 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,090 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,090 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,091 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,091 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,091 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,091 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,172 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:28,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 20:10:28,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:28,177 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:10:28,229 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-21 20:10:28,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,229 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:28,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689970227857Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689970228090 (+233 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689970228090Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689970228114 (+24 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689970228154 (+40 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689970228229 (+75 ms) 2023-07-21 20:10:28,232 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 20:10:28,234 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 373 msec 2023-07-21 20:10:28,477 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:28,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 20:10:28,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:10:28,513 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:28,521 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:28,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45843] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:10:28,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:10:28,532 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-21 20:10:28,533 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:28,536 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:10:28,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 20:10:28,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970228573 (current time:1689970228573). 2023-07-21 20:10:28,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:10:28,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x34a56476 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:28,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@790f5fcd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:28,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:28,588 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:28,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34a56476 to 127.0.0.1:57298 2023-07-21 20:10:28,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:28,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x6172b146 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:28,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7eebffca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:28,602 DEBUG [hconnection-0x7d9926ed-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:28,606 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:28,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:28,614 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:28,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6172b146 to 127.0.0.1:57298 2023-07-21 20:10:28,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:28,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 20:10:28,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:10:28,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 20:10:28,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 20:10:28,623 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 20:10:28,625 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689970828625 2023-07-21 20:10:28,625 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-21 20:10:28,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 20:10:28,627 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:10:28,627 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:10:28,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 20:10:28,629 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 20:10:28,631 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 10 msec 2023-07-21 20:10:28,632 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 20:10:28,633 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689970828633 2023-07-21 20:10:28,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-21 20:10:28,651 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-21 20:10:28,651 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:28,652 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-21 20:10:28,652 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-21 20:10:28,653 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,653 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,654 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,654 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,655 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,654 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:28,655 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,655 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,656 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,656 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:10:28,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 20:10:28,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 20:10:28,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 20:10:28,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,657 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 20:10:28,657 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 20:10:28,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 20:10:28,657 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 20:10:28,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 20:10:28,657 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 20:10:28,657 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 20:10:28,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 20:10:28,657 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:28,658 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 20:10:28,659 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 20:10:28,659 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 20:10:28,658 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:28,659 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 20:10:28,659 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 20:10:28,664 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 20:10:28,665 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 20:10:28,665 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 20:10:28,665 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 20:10:28,665 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 20:10:28,668 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,668 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,675 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:28,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-21 20:10:28,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19e587f4[Count = 1] remaining members to acquire global barrier 2023-07-21 20:10:28,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-21 20:10:28,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19e587f4[Count = 0] remaining members to acquire global barrier 2023-07-21 20:10:28,680 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-21 20:10:28,680 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,688 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,688 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,688 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,689 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,689 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 20:10:28,689 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 20:10:28,689 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 20:10:28,689 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 20:10:28,689 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38477,1689970216099' in zk 2023-07-21 20:10:28,689 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,689 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:10:28,689 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:28,689 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:28,689 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:28,689 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:28,690 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. started... 2023-07-21 20:10:28,690 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:28,690 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. started... 2023-07-21 20:10:28,690 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 759d8825784f8d336958b919ea11e138 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-21 20:10:28,690 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 450788d3f724be40f90d567e00e5f98c 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-21 20:10:28,693 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 20:10:28,693 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:28,693 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 20:10:28,727 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:28,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 20:10:28,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:28,729 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:10:28,807 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/.tmp/cf/6076371026de4a659e408119905946a5 2023-07-21 20:10:28,807 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/.tmp/cf/57aa2eb5308146e9a7d49cf68035dc8f 2023-07-21 20:10:28,865 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/.tmp/cf/57aa2eb5308146e9a7d49cf68035dc8f as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/cf/57aa2eb5308146e9a7d49cf68035dc8f 2023-07-21 20:10:28,865 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/.tmp/cf/6076371026de4a659e408119905946a5 as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/cf/6076371026de4a659e408119905946a5 2023-07-21 20:10:28,877 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/cf/6076371026de4a659e408119905946a5, entries=47, sequenceid=6, filesize=8.0 K 2023-07-21 20:10:28,877 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/cf/57aa2eb5308146e9a7d49cf68035dc8f, entries=3, sequenceid=6, filesize=5.0 K 2023-07-21 20:10:28,882 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 450788d3f724be40f90d567e00e5f98c in 192ms, sequenceid=6, compaction requested=false 2023-07-21 20:10:28,882 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-21 20:10:28,882 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 759d8825784f8d336958b919ea11e138 in 192ms, sequenceid=6, compaction requested=false 2023-07-21 20:10:28,882 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-21 20:10:28,884 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 759d8825784f8d336958b919ea11e138: 2023-07-21 20:10:28,884 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 450788d3f724be40f90d567e00e5f98c: 2023-07-21 20:10:28,885 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 20:10:28,885 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:28,885 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 20:10:28,885 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/cf/57aa2eb5308146e9a7d49cf68035dc8f] hfiles 2023-07-21 20:10:28,885 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:28,885 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/cf/57aa2eb5308146e9a7d49cf68035dc8f for snapshot=snaptb0-testExportWithTargetName 2023-07-21 20:10:28,885 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/cf/6076371026de4a659e408119905946a5] hfiles 2023-07-21 20:10:28,886 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/cf/6076371026de4a659e408119905946a5 for snapshot=snaptb0-testExportWithTargetName 2023-07-21 20:10:28,929 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:28,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 20:10:28,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:28,932 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:10:28,952 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. completed. 2023-07-21 20:10:28,953 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:28,953 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:28,953 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:28,953 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. completed. 2023-07-21 20:10:28,953 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,953 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:28,953 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 20:10:28,953 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45843,1689970216044' in zk 2023-07-21 20:10:28,953 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:28,953 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:28,953 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,953 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 20:10:28,953 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39241,1689970215968' in zk 2023-07-21 20:10:28,956 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 20:10:28,956 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,956 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:28,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,956 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 20:10:28,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,957 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 20:10:28,957 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,957 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:28,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,958 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 20:10:28,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45843,1689970216044': 2023-07-21 20:10:28,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-21 20:10:28,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39241,1689970215968': 2023-07-21 20:10:28,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-21 20:10:28,974 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-21 20:10:28,974 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:10:28,974 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:10:28,974 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-21 20:10:28,974 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:10:28,976 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,976 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,976 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,976 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,976 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,976 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,976 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:28,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:28,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:28,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,977 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,978 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:28,979 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:28,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,982 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:28,984 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 20:10:28,985 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:28,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:28,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:28,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:29,001 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:29,001 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:29,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:29,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:29,001 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:29,001 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:29,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:29,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:29,001 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:29,001 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:29,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:29,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:29,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:29,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:29,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:29,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:29,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:29,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:29,003 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:29,003 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:29,003 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:29,003 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:29,003 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 20:10:29,003 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:29,003 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:29,003 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:29,003 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:29,003 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:29,005 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 20:10:29,005 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 20:10:29,003 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-21 20:10:29,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-21 20:10:29,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 20:10:29,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-21 20:10:29,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-21 20:10:29,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 20:10:29,090 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 20:10:29,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689970228625Consolidate snapshot: snaptb0-testExportWithTargetName at 1689970229005 (+380 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689970229005Writing data manifest for snaptb0-testExportWithTargetName at 1689970229011 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689970229032 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689970229089 (+57 ms) 2023-07-21 20:10:29,092 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 20:10:29,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 466 msec 2023-07-21 20:10:29,232 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:29,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 20:10:29,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:10:29,237 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970229237 2023-07-21 20:10:29,238 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33875, tgtDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970229237, rawTgtDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970229237, srcFsUri=hdfs://localhost:33875, srcDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:10:29,306 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:10:29,307 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-925304398_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970229237, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970229237/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-21 20:10:29,307 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091, snapshotDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-21 20:10:29,354 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970229237/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-21 20:10:29,504 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:29,505 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:29,505 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:29,506 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,548 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-2159106860494096016.jar 2023-07-21 20:10:30,549 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,549 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,620 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-7777012129506788358.jar 2023-07-21 20:10:30,620 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,621 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,621 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,622 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,622 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,623 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:30,624 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:10:30,624 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:10:30,625 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:10:30,626 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:10:30,627 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:10:30,628 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:10:30,628 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:10:30,628 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:10:30,629 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:10:30,630 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:10:30,634 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:30,634 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:30,634 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:10:30,635 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:30,635 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:30,636 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:10:30,636 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:10:32,259 WARN [Listener at jenkins-hbase4.apache.org/33191] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:10:32,265 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-21 20:10:32,274 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 20:10:32,655 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:10:32,872 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:10:32,872 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:10:33,334 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0001_000001 (auth:SIMPLE) 2023-07-21 20:10:38,612 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0001_000001 (auth:SIMPLE) 2023-07-21 20:10:40,900 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0001_000001 (auth:SIMPLE) 2023-07-21 20:10:44,015 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0001_000001 (auth:SIMPLE) 2023-07-21 20:10:45,278 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:10:45,280 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:10:45,289 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-21 20:10:45,289 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:10:45,290 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:10:45,290 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1181763459_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-21 20:10:45,291 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-21 20:10:45,291 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-21 20:10:45,291 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1181763459_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970229237/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970229237/.hbase-snapshot/testExportWithTargetName 2023-07-21 20:10:45,291 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970229237/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-21 20:10:45,291 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970229237/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-21 20:10:45,302 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-21 20:10:45,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-21 20:10:45,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:45,321 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970245320"}]},"ts":"1689970245320"} 2023-07-21 20:10:45,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 20:10:45,322 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-21 20:10:45,324 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-21 20:10:45,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759d8825784f8d336958b919ea11e138, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=450788d3f724be40f90d567e00e5f98c, UNASSIGN}] 2023-07-21 20:10:45,328 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759d8825784f8d336958b919ea11e138, UNASSIGN 2023-07-21 20:10:45,328 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=450788d3f724be40f90d567e00e5f98c, UNASSIGN 2023-07-21 20:10:45,329 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=759d8825784f8d336958b919ea11e138, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:45,329 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970245329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970245329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970245329"}]},"ts":"1689970245329"} 2023-07-21 20:10:45,329 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=450788d3f724be40f90d567e00e5f98c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:45,330 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970245329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970245329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970245329"}]},"ts":"1689970245329"} 2023-07-21 20:10:45,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 759d8825784f8d336958b919ea11e138, server=jenkins-hbase4.apache.org,45843,1689970216044}] 2023-07-21 20:10:45,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 450788d3f724be40f90d567e00e5f98c, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:10:45,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 20:10:45,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 450788d3f724be40f90d567e00e5f98c 2023-07-21 20:10:45,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 759d8825784f8d336958b919ea11e138 2023-07-21 20:10:45,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 450788d3f724be40f90d567e00e5f98c, disabling compactions & flushes 2023-07-21 20:10:45,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 759d8825784f8d336958b919ea11e138, disabling compactions & flushes 2023-07-21 20:10:45,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:45,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:45,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:45,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:45,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. after waiting 0 ms 2023-07-21 20:10:45,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. after waiting 0 ms 2023-07-21 20:10:45,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:45,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:45,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:10:45,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:10:45,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:10:45,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:10:45,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138. 2023-07-21 20:10:45,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c. 2023-07-21 20:10:45,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 759d8825784f8d336958b919ea11e138: 2023-07-21 20:10:45,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 450788d3f724be40f90d567e00e5f98c: 2023-07-21 20:10:45,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 759d8825784f8d336958b919ea11e138 2023-07-21 20:10:45,515 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=759d8825784f8d336958b919ea11e138, regionState=CLOSED 2023-07-21 20:10:45,515 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970245514"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970245514"}]},"ts":"1689970245514"} 2023-07-21 20:10:45,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 450788d3f724be40f90d567e00e5f98c 2023-07-21 20:10:45,516 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=450788d3f724be40f90d567e00e5f98c, regionState=CLOSED 2023-07-21 20:10:45,516 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689970245516"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970245516"}]},"ts":"1689970245516"} 2023-07-21 20:10:45,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-21 20:10:45,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 759d8825784f8d336958b919ea11e138, server=jenkins-hbase4.apache.org,45843,1689970216044 in 186 msec 2023-07-21 20:10:45,521 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-21 20:10:45,521 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 450788d3f724be40f90d567e00e5f98c, server=jenkins-hbase4.apache.org,39241,1689970215968 in 186 msec 2023-07-21 20:10:45,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759d8825784f8d336958b919ea11e138, UNASSIGN in 195 msec 2023-07-21 20:10:45,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-21 20:10:45,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=450788d3f724be40f90d567e00e5f98c, UNASSIGN in 195 msec 2023-07-21 20:10:45,525 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970245525"}]},"ts":"1689970245525"} 2023-07-21 20:10:45,526 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-21 20:10:45,529 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-21 20:10:45,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 220 msec 2023-07-21 20:10:45,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 20:10:45,624 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-21 20:10:45,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-21 20:10:45,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:45,639 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:45,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-21 20:10:45,641 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:45,645 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-21 20:10:45,647 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138 2023-07-21 20:10:45,647 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c 2023-07-21 20:10:45,651 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/recovered.edits] 2023-07-21 20:10:45,651 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/recovered.edits] 2023-07-21 20:10:45,653 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 20:10:45,653 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 20:10:45,653 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 20:10:45,653 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 20:10:45,655 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:45,655 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:45,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 20:10:45,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 20:10:45,655 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:45,655 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:10:45,655 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:10:45,655 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:45,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 20:10:45,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 20:10:45,655 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:10:45,655 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:10:45,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-21 20:10:45,659 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/cf/6076371026de4a659e408119905946a5 to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/cf/6076371026de4a659e408119905946a5 2023-07-21 20:10:45,659 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/cf/57aa2eb5308146e9a7d49cf68035dc8f to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/cf/57aa2eb5308146e9a7d49cf68035dc8f 2023-07-21 20:10:45,664 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/recovered.edits/9.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138/recovered.edits/9.seqid 2023-07-21 20:10:45,664 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/recovered.edits/9.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c/recovered.edits/9.seqid 2023-07-21 20:10:45,665 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/759d8825784f8d336958b919ea11e138 2023-07-21 20:10:45,665 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportWithTargetName/450788d3f724be40f90d567e00e5f98c 2023-07-21 20:10:45,665 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-21 20:10:45,668 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:45,689 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-21 20:10:45,692 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-21 20:10:45,693 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:45,693 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-21 20:10:45,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970245693"}]},"ts":"9223372036854775807"} 2023-07-21 20:10:45,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970245693"}]},"ts":"9223372036854775807"} 2023-07-21 20:10:45,696 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 20:10:45,696 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 759d8825784f8d336958b919ea11e138, NAME => 'testtb-testExportWithTargetName,,1689970226602.759d8825784f8d336958b919ea11e138.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 450788d3f724be40f90d567e00e5f98c, NAME => 'testtb-testExportWithTargetName,1,1689970226602.450788d3f724be40f90d567e00e5f98c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 20:10:45,696 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-21 20:10:45,696 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970245696"}]},"ts":"9223372036854775807"} 2023-07-21 20:10:45,698 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-21 20:10:45,701 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 20:10:45,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 71 msec 2023-07-21 20:10:45,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-21 20:10:45,759 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-21 20:10:45,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-21 20:10:45,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-21 20:10:45,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-21 20:10:45,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-21 20:10:45,813 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=756 (was 711) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:40666 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:34904 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1735367211_1 at /127.0.0.1:40636 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:53106 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:42321 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1735367211_1 at /127.0.0.1:34890 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:34251 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1284 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=350 (was 304) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=7676 (was 9360) 2023-07-21 20:10:45,814 WARN [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-21 20:10:45,833 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=350, ProcessCount=185, AvailableMemoryMB=7676 2023-07-21 20:10:45,833 WARN [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-21 20:10:45,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 20:10:45,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:10:45,839 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:10:45,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-21 20:10:45,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 20:10:45,841 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:10:45,844 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9 2023-07-21 20:10:45,844 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860 2023-07-21 20:10:45,844 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9 empty. 2023-07-21 20:10:45,844 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860 empty. 2023-07-21 20:10:45,845 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9 2023-07-21 20:10:45,845 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860 2023-07-21 20:10:45,845 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-21 20:10:45,865 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-21 20:10:45,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0d96a319fc9a6f318432cea496642860, NAME => 'testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:10:45,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 857b77e226ec3834eb47207a15a068b9, NAME => 'testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:10:45,890 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:45,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:45,892 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 0d96a319fc9a6f318432cea496642860, disabling compactions & flushes 2023-07-21 20:10:45,892 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 857b77e226ec3834eb47207a15a068b9, disabling compactions & flushes 2023-07-21 20:10:45,892 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:10:45,892 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:10:45,892 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:10:45,892 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:10:45,892 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. after waiting 0 ms 2023-07-21 20:10:45,892 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. after waiting 0 ms 2023-07-21 20:10:45,892 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:10:45,892 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:10:45,892 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:10:45,892 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:10:45,892 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 0d96a319fc9a6f318432cea496642860: 2023-07-21 20:10:45,892 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 857b77e226ec3834eb47207a15a068b9: 2023-07-21 20:10:45,895 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:10:45,896 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970245896"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970245896"}]},"ts":"1689970245896"} 2023-07-21 20:10:45,896 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970245896"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970245896"}]},"ts":"1689970245896"} 2023-07-21 20:10:45,899 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:10:45,900 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:10:45,900 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970245900"}]},"ts":"1689970245900"} 2023-07-21 20:10:45,902 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-21 20:10:45,905 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:10:45,906 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:10:45,906 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:10:45,906 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:10:45,906 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:10:45,907 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=857b77e226ec3834eb47207a15a068b9, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d96a319fc9a6f318432cea496642860, ASSIGN}] 2023-07-21 20:10:45,909 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d96a319fc9a6f318432cea496642860, ASSIGN 2023-07-21 20:10:45,909 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=857b77e226ec3834eb47207a15a068b9, ASSIGN 2023-07-21 20:10:45,910 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=857b77e226ec3834eb47207a15a068b9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45843,1689970216044; forceNewPlan=false, retain=false 2023-07-21 20:10:45,910 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d96a319fc9a6f318432cea496642860, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39241,1689970215968; forceNewPlan=false, retain=false 2023-07-21 20:10:45,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 20:10:46,061 INFO [jenkins-hbase4:34903] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:10:46,064 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=857b77e226ec3834eb47207a15a068b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,064 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0d96a319fc9a6f318432cea496642860, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:46,064 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970246063"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970246063"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970246063"}]},"ts":"1689970246063"} 2023-07-21 20:10:46,064 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970246063"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970246063"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970246063"}]},"ts":"1689970246063"} 2023-07-21 20:10:46,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 0d96a319fc9a6f318432cea496642860, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:10:46,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 857b77e226ec3834eb47207a15a068b9, server=jenkins-hbase4.apache.org,45843,1689970216044}] 2023-07-21 20:10:46,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 20:10:46,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:10:46,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d96a319fc9a6f318432cea496642860, NAME => 'testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 20:10:46,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. service=AccessControlService 2023-07-21 20:10:46,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:46,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 0d96a319fc9a6f318432cea496642860 2023-07-21 20:10:46,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:46,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:10:46,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0d96a319fc9a6f318432cea496642860 2023-07-21 20:10:46,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0d96a319fc9a6f318432cea496642860 2023-07-21 20:10:46,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 857b77e226ec3834eb47207a15a068b9, NAME => 'testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 20:10:46,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. service=AccessControlService 2023-07-21 20:10:46,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:10:46,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 857b77e226ec3834eb47207a15a068b9 2023-07-21 20:10:46,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:10:46,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 857b77e226ec3834eb47207a15a068b9 2023-07-21 20:10:46,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 857b77e226ec3834eb47207a15a068b9 2023-07-21 20:10:46,226 INFO [StoreOpener-0d96a319fc9a6f318432cea496642860-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0d96a319fc9a6f318432cea496642860 2023-07-21 20:10:46,227 INFO [StoreOpener-857b77e226ec3834eb47207a15a068b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 857b77e226ec3834eb47207a15a068b9 2023-07-21 20:10:46,227 DEBUG [StoreOpener-0d96a319fc9a6f318432cea496642860-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/cf 2023-07-21 20:10:46,227 DEBUG [StoreOpener-0d96a319fc9a6f318432cea496642860-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/cf 2023-07-21 20:10:46,228 INFO [StoreOpener-0d96a319fc9a6f318432cea496642860-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d96a319fc9a6f318432cea496642860 columnFamilyName cf 2023-07-21 20:10:46,228 DEBUG [StoreOpener-857b77e226ec3834eb47207a15a068b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/cf 2023-07-21 20:10:46,228 DEBUG [StoreOpener-857b77e226ec3834eb47207a15a068b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/cf 2023-07-21 20:10:46,228 INFO [StoreOpener-857b77e226ec3834eb47207a15a068b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 857b77e226ec3834eb47207a15a068b9 columnFamilyName cf 2023-07-21 20:10:46,229 INFO [StoreOpener-0d96a319fc9a6f318432cea496642860-1] regionserver.HStore(310): Store=0d96a319fc9a6f318432cea496642860/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:46,230 INFO [StoreOpener-857b77e226ec3834eb47207a15a068b9-1] regionserver.HStore(310): Store=857b77e226ec3834eb47207a15a068b9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:10:46,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860 2023-07-21 20:10:46,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9 2023-07-21 20:10:46,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860 2023-07-21 20:10:46,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9 2023-07-21 20:10:46,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0d96a319fc9a6f318432cea496642860 2023-07-21 20:10:46,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 857b77e226ec3834eb47207a15a068b9 2023-07-21 20:10:46,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:46,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:10:46,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0d96a319fc9a6f318432cea496642860; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64804435, jitterRate=-0.03433866798877716}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:46,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 857b77e226ec3834eb47207a15a068b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66373879, jitterRate=-0.01095212996006012}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:10:46,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0d96a319fc9a6f318432cea496642860: 2023-07-21 20:10:46,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 857b77e226ec3834eb47207a15a068b9: 2023-07-21 20:10:46,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860., pid=30, masterSystemTime=1689970246219 2023-07-21 20:10:46,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9., pid=31, masterSystemTime=1689970246221 2023-07-21 20:10:46,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:10:46,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:10:46,243 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0d96a319fc9a6f318432cea496642860, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:46,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:10:46,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:10:46,244 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970246243"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970246243"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970246243"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970246243"}]},"ts":"1689970246243"} 2023-07-21 20:10:46,244 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=857b77e226ec3834eb47207a15a068b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,244 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970246244"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970246244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970246244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970246244"}]},"ts":"1689970246244"} 2023-07-21 20:10:46,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-21 20:10:46,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 0d96a319fc9a6f318432cea496642860, server=jenkins-hbase4.apache.org,39241,1689970215968 in 180 msec 2023-07-21 20:10:46,252 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-21 20:10:46,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 857b77e226ec3834eb47207a15a068b9, server=jenkins-hbase4.apache.org,45843,1689970216044 in 179 msec 2023-07-21 20:10:46,253 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d96a319fc9a6f318432cea496642860, ASSIGN in 343 msec 2023-07-21 20:10:46,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-21 20:10:46,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=857b77e226ec3834eb47207a15a068b9, ASSIGN in 346 msec 2023-07-21 20:10:46,257 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:10:46,257 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970246257"}]},"ts":"1689970246257"} 2023-07-21 20:10:46,259 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-21 20:10:46,262 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:10:46,262 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-21 20:10:46,265 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 20:10:46,266 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:46,266 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:46,266 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:46,266 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:10:46,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:46,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:46,273 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:46,273 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:10:46,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 436 msec 2023-07-21 20:10:46,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 20:10:46,445 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-21 20:10:46,445 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-21 20:10:46,445 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:10:46,449 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-21 20:10:46,450 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:10:46,450 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-21 20:10:46,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:10:46,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970246453 (current time:1689970246453). 2023-07-21 20:10:46,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:10:46,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x6adc8107 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:46,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c656eb7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:46,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:46,464 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:46,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6adc8107 to 127.0.0.1:57298 2023-07-21 20:10:46,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:46,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x4a03cdc1 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:46,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4459a93f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:46,571 DEBUG [hconnection-0x33be77d5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:46,575 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:46,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:46,583 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:46,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a03cdc1 to 127.0.0.1:57298 2023-07-21 20:10:46,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:46,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 20:10:46,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:10:46,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:10:46,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:10:46,592 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:10:46,594 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689970846594 2023-07-21 20:10:46,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:10:46,594 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-21 20:10:46,595 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:10:46,596 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:10:46,598 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:10:46,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 20:10:46,601 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-21 20:10:46,604 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 20:10:46,605 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689970846605 2023-07-21 20:10:46,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,625 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-21 20:10:46,625 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:46,627 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-21 20:10:46,627 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-21 20:10:46,628 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,628 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,630 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:46,630 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:46,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:46,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:46,630 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,630 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:46,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,631 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,631 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:46,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,632 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:46,632 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:10:46,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 20:10:46,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,632 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 20:10:46,633 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,633 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 20:10:46,633 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:46,634 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 20:10:46,634 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 20:10:46,634 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 20:10:46,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 20:10:46,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 20:10:46,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 20:10:46,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 20:10:46,635 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,635 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 20:10:46,635 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,635 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:46,635 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 20:10:46,636 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 20:10:46,636 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 20:10:46,636 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:46,636 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 20:10:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 20:10:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 20:10:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 20:10:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:46,644 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,644 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:46,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:46,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:46,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:46,645 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,645 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,645 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,645 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:46,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:46,645 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,645 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:46,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:46,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-21 20:10:46,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59cd81e0[Count = 1] remaining members to acquire global barrier 2023-07-21 20:10:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:46,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:46,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:46,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:46,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:46,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:46,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-21 20:10:46,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59cd81e0[Count = 0] remaining members to acquire global barrier 2023-07-21 20:10:46,650 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 20:10:46,650 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,651 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,651 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,651 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,651 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:10:46,651 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:46,651 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 20:10:46,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:10:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38477,1689970216099' in zk 2023-07-21 20:10:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:10:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:46,652 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,652 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:10:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:46,652 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:10:46,652 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:10:46,652 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. started... 2023-07-21 20:10:46,652 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:46,652 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. started... 2023-07-21 20:10:46,656 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d96a319fc9a6f318432cea496642860: 2023-07-21 20:10:46,656 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 857b77e226ec3834eb47207a15a068b9: 2023-07-21 20:10:46,656 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 20:10:46,656 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:46,656 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,656 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,656 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 20:10:46,657 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:46,657 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:46,657 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:10:46,657 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:10:46,689 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. completed. 2023-07-21 20:10:46,690 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:10:46,692 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:46,692 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:46,692 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,692 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 20:10:46,692 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45843,1689970216044' in zk 2023-07-21 20:10:46,694 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,695 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 20:10:46,695 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:46,695 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 20:10:46,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:46,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:46,697 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:46,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:46,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:46,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:10:46,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:46,699 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:10:46,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:46,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:46,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:46,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:46,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45843,1689970216044': 2023-07-21 20:10:46,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 20:10:46,899 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:46,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:10:46,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:46,900 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:10:47,098 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. completed. 2023-07-21 20:10:47,098 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:10:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 20:10:47,099 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39241,1689970215968' in zk 2023-07-21 20:10:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 20:10:47,102 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:47,102 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 20:10:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:47,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:47,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:47,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:47,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:47,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39241,1689970215968': 2023-07-21 20:10:47,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 20:10:47,110 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-21 20:10:47,110 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:10:47,110 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:10:47,110 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,110 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:10:47,113 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,113 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,113 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,113 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,113 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,113 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,113 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:47,116 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,117 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:47,117 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:47,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,120 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,121 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,121 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,125 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,125 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,125 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,125 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,125 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,125 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,126 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,126 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,126 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,126 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:47,126 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,126 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,126 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,128 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,128 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,129 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,129 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,129 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,201 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:47,201 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-21 20:10:47,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,201 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 20:10:47,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689970246595Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689970247128 (+533 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689970247129 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689970247140 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689970247171 (+31 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689970247201 (+30 ms) 2023-07-21 20:10:47,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:10:47,204 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 20:10:47,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:10:47,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 609 msec 2023-07-21 20:10:47,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45843] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:10:47,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:10:47,219 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-21 20:10:47,219 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:10:47,219 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:10:47,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:10:47,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970247230 (current time:1689970247230). 2023-07-21 20:10:47,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:10:47,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x43b08c23 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:47,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18bea11f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:47,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:47,240 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:47,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43b08c23 to 127.0.0.1:57298 2023-07-21 20:10:47,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:47,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x5b65e932 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:10:47,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71a84b31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:10:47,250 DEBUG [hconnection-0x5895cac0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:47,251 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:47,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:10:47,257 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:10:47,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b65e932 to 127.0.0.1:57298 2023-07-21 20:10:47,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:10:47,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 20:10:47,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:10:47,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:10:47,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:10:47,262 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:10:47,263 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689970847263 2023-07-21 20:10:47,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:10:47,263 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-21 20:10:47,264 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:10:47,264 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:10:47,265 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:10:47,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 20:10:47,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-21 20:10:47,267 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 20:10:47,268 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689970847268 2023-07-21 20:10:47,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-21 20:10:47,282 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-21 20:10:47,282 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:47,283 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-21 20:10:47,283 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-21 20:10:47,284 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,284 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,285 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,285 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,285 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,285 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,286 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,286 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,286 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,286 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:10:47,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 20:10:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 20:10:47,287 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 20:10:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 20:10:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,287 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 20:10:47,287 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 20:10:47,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 20:10:47,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 20:10:47,287 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 20:10:47,287 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 20:10:47,287 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:47,287 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:47,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 20:10:47,289 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 20:10:47,289 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 20:10:47,289 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:10:47,288 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 20:10:47,290 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 20:10:47,290 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 20:10:47,290 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 20:10:47,290 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 20:10:47,289 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 20:10:47,290 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 20:10:47,290 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 20:10:47,292 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,292 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,292 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:47,294 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:47,294 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,294 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,294 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:47,294 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,294 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:47,294 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,294 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:10:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:47,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-21 20:10:47,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1693c124[Count = 1] remaining members to acquire global barrier 2023-07-21 20:10:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:47,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-21 20:10:47,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1693c124[Count = 0] remaining members to acquire global barrier 2023-07-21 20:10:47,298 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 20:10:47,298 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,299 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,299 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,299 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,299 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:10:47,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,299 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,299 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 20:10:47,299 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:10:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,299 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38477,1689970216099' in zk 2023-07-21 20:10:47,299 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:10:47,299 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:47,300 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:10:47,300 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:10:47,300 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. started... 2023-07-21 20:10:47,300 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:10:47,299 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,300 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:10:47,300 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. started... 2023-07-21 20:10:47,300 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:47,300 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:10:47,300 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 857b77e226ec3834eb47207a15a068b9 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-21 20:10:47,300 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0d96a319fc9a6f318432cea496642860 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-21 20:10:47,301 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 20:10:47,301 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:47,301 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 20:10:47,325 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/.tmp/cf/c491a8e13a59478cb4ef131796c2f43c 2023-07-21 20:10:47,327 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/.tmp/cf/fe4ba3d03c76495898ab4162653b12ea 2023-07-21 20:10:47,339 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/.tmp/cf/c491a8e13a59478cb4ef131796c2f43c as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/cf/c491a8e13a59478cb4ef131796c2f43c 2023-07-21 20:10:47,339 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/.tmp/cf/fe4ba3d03c76495898ab4162653b12ea as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/cf/fe4ba3d03c76495898ab4162653b12ea 2023-07-21 20:10:47,345 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/cf/c491a8e13a59478cb4ef131796c2f43c, entries=2, sequenceid=6, filesize=5.0 K 2023-07-21 20:10:47,349 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 857b77e226ec3834eb47207a15a068b9 in 49ms, sequenceid=6, compaction requested=false 2023-07-21 20:10:47,349 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-21 20:10:47,349 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/cf/fe4ba3d03c76495898ab4162653b12ea, entries=48, sequenceid=6, filesize=8.1 K 2023-07-21 20:10:47,349 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 857b77e226ec3834eb47207a15a068b9: 2023-07-21 20:10:47,351 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 20:10:47,351 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:47,351 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/cf/c491a8e13a59478cb4ef131796c2f43c] hfiles 2023-07-21 20:10:47,351 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/cf/c491a8e13a59478cb4ef131796c2f43c for snapshot=snaptb0-testExportFileSystemState 2023-07-21 20:10:47,352 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 0d96a319fc9a6f318432cea496642860 in 51ms, sequenceid=6, compaction requested=false 2023-07-21 20:10:47,352 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d96a319fc9a6f318432cea496642860: 2023-07-21 20:10:47,353 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 20:10:47,353 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:10:47,353 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/cf/fe4ba3d03c76495898ab4162653b12ea] hfiles 2023-07-21 20:10:47,353 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/cf/fe4ba3d03c76495898ab4162653b12ea for snapshot=snaptb0-testExportFileSystemState 2023-07-21 20:10:47,364 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:47,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:10:47,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:10:47,366 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:10:47,387 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. completed. 2023-07-21 20:10:47,388 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:10:47,388 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:47,388 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:47,388 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,388 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 20:10:47,388 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45843,1689970216044' in zk 2023-07-21 20:10:47,394 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,394 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 20:10:47,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,395 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:47,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:47,395 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 20:10:47,396 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. completed. 2023-07-21 20:10:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:47,396 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:10:47,396 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:10:47,396 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:10:47,396 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,397 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 20:10:47,397 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39241,1689970215968' in zk 2023-07-21 20:10:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:47,399 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 20:10:47,399 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:47,399 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:47,399 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 20:10:47,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:47,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:47,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45843,1689970216044': 2023-07-21 20:10:47,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 20:10:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:47,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:47,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39241,1689970215968': 2023-07-21 20:10:47,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 20:10:47,409 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-21 20:10:47,409 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:10:47,409 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:10:47,409 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-21 20:10:47,409 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:10:47,411 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,411 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,411 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,411 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,411 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:10:47,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,411 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:10:47,411 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,417 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:10:47,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,417 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:47,418 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:10:47,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:47,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:10:47,421 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 20:10:47,421 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,422 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,429 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,429 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,429 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,429 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,429 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,429 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,430 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,430 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:10:47,430 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:10:47,430 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,430 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,430 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:10:47,430 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-21 20:10:47,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-21 20:10:47,430 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,431 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:10:47,431 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:10:47,431 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,431 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,430 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:10:47,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:10:47,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:10:47,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:10:47,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:10:47,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,497 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-21 20:10:47,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,498 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689970247263Consolidate snapshot: snaptb0-testExportFileSystemState at 1689970247430 (+167 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689970247431 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689970247437 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689970247452 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689970247497 (+45 ms) 2023-07-21 20:10:47,501 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 20:10:47,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 237 msec 2023-07-21 20:10:47,566 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:10:47,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:10:47,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:10:47,569 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970247569 2023-07-21 20:10:47,569 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33875, tgtDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970247569, rawTgtDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970247569, srcFsUri=hdfs://localhost:33875, srcDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:10:47,597 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:10:47,597 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_813670055_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970247569, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970247569/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,597 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091, snapshotDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-21 20:10:47,607 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970247569/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 20:10:47,638 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:47,639 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:47,639 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:47,640 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:48,615 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-3811380409424785039.jar 2023-07-21 20:10:48,616 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:48,616 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:48,686 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-4825767709176853802.jar 2023-07-21 20:10:48,686 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:48,687 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:48,687 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:48,688 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:48,688 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:48,688 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:10:48,689 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:10:48,689 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:10:48,689 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:10:48,690 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:10:48,690 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:10:48,691 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:10:48,691 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:10:48,691 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:10:48,692 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:10:48,692 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:10:48,693 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:48,693 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:48,694 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:10:48,694 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:48,694 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:10:48,695 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:10:48,696 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:10:49,294 WARN [Listener at jenkins-hbase4.apache.org/33191] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:10:49,297 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-21 20:10:49,299 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 20:10:50,239 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:10:50,243 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:10:50,251 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0001_000001 (auth:SIMPLE) 2023-07-21 20:10:50,517 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0002_000001 (auth:SIMPLE) 2023-07-21 20:10:51,115 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:10:55,168 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0002_000001 (auth:SIMPLE) 2023-07-21 20:10:57,438 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0002_000001 (auth:SIMPLE) 2023-07-21 20:11:00,910 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0002_000001 (auth:SIMPLE) 2023-07-21 20:11:02,539 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:11:02,541 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:11:02,549 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-21 20:11:02,549 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:11:02,550 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:11:02,550 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1181763459_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 20:11:02,550 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-21 20:11:02,551 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-21 20:11:02,551 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1181763459_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970247569/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970247569/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 20:11:02,551 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970247569/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-21 20:11:02,551 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970247569/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-21 20:11:02,558 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-21 20:11:02,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-21 20:11:02,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:02,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 20:11:02,563 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970262563"}]},"ts":"1689970262563"} 2023-07-21 20:11:02,565 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-21 20:11:02,566 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-21 20:11:02,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=857b77e226ec3834eb47207a15a068b9, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d96a319fc9a6f318432cea496642860, UNASSIGN}] 2023-07-21 20:11:02,569 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d96a319fc9a6f318432cea496642860, UNASSIGN 2023-07-21 20:11:02,570 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=857b77e226ec3834eb47207a15a068b9, UNASSIGN 2023-07-21 20:11:02,570 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0d96a319fc9a6f318432cea496642860, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:02,570 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970262570"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970262570"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970262570"}]},"ts":"1689970262570"} 2023-07-21 20:11:02,571 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=857b77e226ec3834eb47207a15a068b9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:02,571 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970262570"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970262570"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970262570"}]},"ts":"1689970262570"} 2023-07-21 20:11:02,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 0d96a319fc9a6f318432cea496642860, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:11:02,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 857b77e226ec3834eb47207a15a068b9, server=jenkins-hbase4.apache.org,45843,1689970216044}] 2023-07-21 20:11:02,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 20:11:02,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0d96a319fc9a6f318432cea496642860 2023-07-21 20:11:02,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0d96a319fc9a6f318432cea496642860, disabling compactions & flushes 2023-07-21 20:11:02,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:11:02,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:11:02,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. after waiting 0 ms 2023-07-21 20:11:02,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:11:02,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 857b77e226ec3834eb47207a15a068b9 2023-07-21 20:11:02,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 857b77e226ec3834eb47207a15a068b9, disabling compactions & flushes 2023-07-21 20:11:02,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:11:02,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:11:02,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. after waiting 0 ms 2023-07-21 20:11:02,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:11:02,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:11:02,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:11:02,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:02,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:02,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9. 2023-07-21 20:11:02,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860. 2023-07-21 20:11:02,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 857b77e226ec3834eb47207a15a068b9: 2023-07-21 20:11:02,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0d96a319fc9a6f318432cea496642860: 2023-07-21 20:11:02,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 857b77e226ec3834eb47207a15a068b9 2023-07-21 20:11:02,748 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=857b77e226ec3834eb47207a15a068b9, regionState=CLOSED 2023-07-21 20:11:02,748 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970262748"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970262748"}]},"ts":"1689970262748"} 2023-07-21 20:11:02,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0d96a319fc9a6f318432cea496642860 2023-07-21 20:11:02,749 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0d96a319fc9a6f318432cea496642860, regionState=CLOSED 2023-07-21 20:11:02,749 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689970262749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970262749"}]},"ts":"1689970262749"} 2023-07-21 20:11:02,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-21 20:11:02,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 857b77e226ec3834eb47207a15a068b9, server=jenkins-hbase4.apache.org,45843,1689970216044 in 177 msec 2023-07-21 20:11:02,753 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-21 20:11:02,753 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 0d96a319fc9a6f318432cea496642860, server=jenkins-hbase4.apache.org,39241,1689970215968 in 179 msec 2023-07-21 20:11:02,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=857b77e226ec3834eb47207a15a068b9, UNASSIGN in 185 msec 2023-07-21 20:11:02,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-21 20:11:02,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0d96a319fc9a6f318432cea496642860, UNASSIGN in 186 msec 2023-07-21 20:11:02,755 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970262755"}]},"ts":"1689970262755"} 2023-07-21 20:11:02,756 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-21 20:11:02,758 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-21 20:11:02,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 201 msec 2023-07-21 20:11:02,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 20:11:02,865 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-21 20:11:02,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-21 20:11:02,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:02,870 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:02,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-21 20:11:02,871 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:02,873 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-21 20:11:02,876 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:02,876 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:02,876 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:02,876 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:02,876 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 20:11:02,876 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 20:11:02,876 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9 2023-07-21 20:11:02,877 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860 2023-07-21 20:11:02,878 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:02,878 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 20:11:02,878 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:02,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-21 20:11:02,878 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:11:02,878 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:02,879 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/recovered.edits] 2023-07-21 20:11:02,879 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/recovered.edits] 2023-07-21 20:11:02,879 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:02,879 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:02,880 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-21 20:11:02,880 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:11:02,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-21 20:11:02,884 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/cf/c491a8e13a59478cb4ef131796c2f43c to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/cf/c491a8e13a59478cb4ef131796c2f43c 2023-07-21 20:11:02,884 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/cf/fe4ba3d03c76495898ab4162653b12ea to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/cf/fe4ba3d03c76495898ab4162653b12ea 2023-07-21 20:11:02,888 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/recovered.edits/9.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9/recovered.edits/9.seqid 2023-07-21 20:11:02,888 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/recovered.edits/9.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860/recovered.edits/9.seqid 2023-07-21 20:11:02,889 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/857b77e226ec3834eb47207a15a068b9 2023-07-21 20:11:02,889 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemState/0d96a319fc9a6f318432cea496642860 2023-07-21 20:11:02,889 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-21 20:11:02,892 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:02,894 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-21 20:11:02,896 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-21 20:11:02,897 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:02,897 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-21 20:11:02,897 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970262897"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:02,897 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970262897"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:02,899 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 20:11:02,899 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 857b77e226ec3834eb47207a15a068b9, NAME => 'testtb-testExportFileSystemState,,1689970245834.857b77e226ec3834eb47207a15a068b9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0d96a319fc9a6f318432cea496642860, NAME => 'testtb-testExportFileSystemState,1,1689970245834.0d96a319fc9a6f318432cea496642860.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 20:11:02,899 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-21 20:11:02,899 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970262899"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:02,901 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-21 20:11:02,903 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 20:11:02,904 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 36 msec 2023-07-21 20:11:02,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-21 20:11:02,982 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-21 20:11:02,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-21 20:11:02,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-21 20:11:02,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-21 20:11:02,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-21 20:11:03,021 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=762 (was 756) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:60140 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:44843 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:35705 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_510395091_1 at /127.0.0.1:56716 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:51478 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:56746 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1952 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=927 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=298 (was 350), ProcessCount=185 (was 185), AvailableMemoryMB=7419 (was 7676) 2023-07-21 20:11:03,021 WARN [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-21 20:11:03,042 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=298, ProcessCount=185, AvailableMemoryMB=7418 2023-07-21 20:11:03,042 WARN [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-21 20:11:03,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 20:11:03,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:03,048 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:11:03,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-21 20:11:03,049 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:11:03,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 20:11:03,052 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b 2023-07-21 20:11:03,052 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8 2023-07-21 20:11:03,053 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8 empty. 2023-07-21 20:11:03,053 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b empty. 2023-07-21 20:11:03,054 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8 2023-07-21 20:11:03,054 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b 2023-07-21 20:11:03,054 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-21 20:11:03,077 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-21 20:11:03,078 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => bd69656c28fbcccef25cd64999de66f8, NAME => 'testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:11:03,078 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => c51933bbe2433979ca6e99e10b74031b, NAME => 'testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:11:03,126 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:03,126 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing bd69656c28fbcccef25cd64999de66f8, disabling compactions & flushes 2023-07-21 20:11:03,126 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:03,126 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:03,127 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. after waiting 0 ms 2023-07-21 20:11:03,127 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:03,127 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:03,127 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for bd69656c28fbcccef25cd64999de66f8: 2023-07-21 20:11:03,133 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:03,133 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing c51933bbe2433979ca6e99e10b74031b, disabling compactions & flushes 2023-07-21 20:11:03,133 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:03,133 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:03,133 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. after waiting 0 ms 2023-07-21 20:11:03,133 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:03,133 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:03,134 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for c51933bbe2433979ca6e99e10b74031b: 2023-07-21 20:11:03,137 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:11:03,138 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970263138"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970263138"}]},"ts":"1689970263138"} 2023-07-21 20:11:03,138 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970263138"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970263138"}]},"ts":"1689970263138"} 2023-07-21 20:11:03,141 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:11:03,142 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:11:03,143 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970263143"}]},"ts":"1689970263143"} 2023-07-21 20:11:03,145 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-21 20:11:03,149 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:11:03,151 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:11:03,151 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:11:03,151 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:11:03,151 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:11:03,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 20:11:03,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c51933bbe2433979ca6e99e10b74031b, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bd69656c28fbcccef25cd64999de66f8, ASSIGN}] 2023-07-21 20:11:03,154 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bd69656c28fbcccef25cd64999de66f8, ASSIGN 2023-07-21 20:11:03,154 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c51933bbe2433979ca6e99e10b74031b, ASSIGN 2023-07-21 20:11:03,155 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c51933bbe2433979ca6e99e10b74031b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45843,1689970216044; forceNewPlan=false, retain=false 2023-07-21 20:11:03,155 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bd69656c28fbcccef25cd64999de66f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39241,1689970215968; forceNewPlan=false, retain=false 2023-07-21 20:11:03,305 INFO [jenkins-hbase4:34903] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:11:03,308 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=bd69656c28fbcccef25cd64999de66f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,308 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c51933bbe2433979ca6e99e10b74031b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,308 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970263308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970263308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970263308"}]},"ts":"1689970263308"} 2023-07-21 20:11:03,308 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970263308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970263308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970263308"}]},"ts":"1689970263308"} 2023-07-21 20:11:03,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure bd69656c28fbcccef25cd64999de66f8, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:11:03,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure c51933bbe2433979ca6e99e10b74031b, server=jenkins-hbase4.apache.org,45843,1689970216044}] 2023-07-21 20:11:03,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 20:11:03,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:03,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bd69656c28fbcccef25cd64999de66f8, NAME => 'testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 20:11:03,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:03,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c51933bbe2433979ca6e99e10b74031b, NAME => 'testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 20:11:03,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. service=AccessControlService 2023-07-21 20:11:03,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. service=AccessControlService 2023-07-21 20:11:03,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:03,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:03,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports bd69656c28fbcccef25cd64999de66f8 2023-07-21 20:11:03,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports c51933bbe2433979ca6e99e10b74031b 2023-07-21 20:11:03,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:03,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:03,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bd69656c28fbcccef25cd64999de66f8 2023-07-21 20:11:03,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c51933bbe2433979ca6e99e10b74031b 2023-07-21 20:11:03,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bd69656c28fbcccef25cd64999de66f8 2023-07-21 20:11:03,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c51933bbe2433979ca6e99e10b74031b 2023-07-21 20:11:03,477 INFO [StoreOpener-bd69656c28fbcccef25cd64999de66f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bd69656c28fbcccef25cd64999de66f8 2023-07-21 20:11:03,479 INFO [StoreOpener-c51933bbe2433979ca6e99e10b74031b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c51933bbe2433979ca6e99e10b74031b 2023-07-21 20:11:03,480 DEBUG [StoreOpener-bd69656c28fbcccef25cd64999de66f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/cf 2023-07-21 20:11:03,480 DEBUG [StoreOpener-bd69656c28fbcccef25cd64999de66f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/cf 2023-07-21 20:11:03,480 INFO [StoreOpener-bd69656c28fbcccef25cd64999de66f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd69656c28fbcccef25cd64999de66f8 columnFamilyName cf 2023-07-21 20:11:03,481 INFO [StoreOpener-bd69656c28fbcccef25cd64999de66f8-1] regionserver.HStore(310): Store=bd69656c28fbcccef25cd64999de66f8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:03,481 DEBUG [StoreOpener-c51933bbe2433979ca6e99e10b74031b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/cf 2023-07-21 20:11:03,481 DEBUG [StoreOpener-c51933bbe2433979ca6e99e10b74031b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/cf 2023-07-21 20:11:03,482 INFO [StoreOpener-c51933bbe2433979ca6e99e10b74031b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c51933bbe2433979ca6e99e10b74031b columnFamilyName cf 2023-07-21 20:11:03,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8 2023-07-21 20:11:03,483 INFO [StoreOpener-c51933bbe2433979ca6e99e10b74031b-1] regionserver.HStore(310): Store=c51933bbe2433979ca6e99e10b74031b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:03,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8 2023-07-21 20:11:03,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b 2023-07-21 20:11:03,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b 2023-07-21 20:11:03,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c51933bbe2433979ca6e99e10b74031b 2023-07-21 20:11:03,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bd69656c28fbcccef25cd64999de66f8 2023-07-21 20:11:03,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:11:03,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:11:03,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bd69656c28fbcccef25cd64999de66f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70157797, jitterRate=0.045432642102241516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:03,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bd69656c28fbcccef25cd64999de66f8: 2023-07-21 20:11:03,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8., pid=45, masterSystemTime=1689970263463 2023-07-21 20:11:03,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:03,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:03,509 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=bd69656c28fbcccef25cd64999de66f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,509 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970263508"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970263508"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970263508"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970263508"}]},"ts":"1689970263508"} 2023-07-21 20:11:03,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c51933bbe2433979ca6e99e10b74031b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74820991, jitterRate=0.11491964757442474}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:03,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c51933bbe2433979ca6e99e10b74031b: 2023-07-21 20:11:03,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b., pid=46, masterSystemTime=1689970263468 2023-07-21 20:11:03,524 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-21 20:11:03,524 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure bd69656c28fbcccef25cd64999de66f8, server=jenkins-hbase4.apache.org,39241,1689970215968 in 210 msec 2023-07-21 20:11:03,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:03,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bd69656c28fbcccef25cd64999de66f8, ASSIGN in 374 msec 2023-07-21 20:11:03,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:03,528 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c51933bbe2433979ca6e99e10b74031b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,528 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970263528"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970263528"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970263528"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970263528"}]},"ts":"1689970263528"} 2023-07-21 20:11:03,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-21 20:11:03,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure c51933bbe2433979ca6e99e10b74031b, server=jenkins-hbase4.apache.org,45843,1689970216044 in 219 msec 2023-07-21 20:11:03,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-21 20:11:03,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c51933bbe2433979ca6e99e10b74031b, ASSIGN in 382 msec 2023-07-21 20:11:03,543 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:11:03,543 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970263543"}]},"ts":"1689970263543"} 2023-07-21 20:11:03,544 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-21 20:11:03,547 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:11:03,548 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-21 20:11:03,551 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 20:11:03,552 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:03,553 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:03,553 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:03,553 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:03,556 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:03,556 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:03,556 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:03,556 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:03,557 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:03,557 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:03,558 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:03,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:03,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 513 msec 2023-07-21 20:11:03,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 20:11:03,654 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-21 20:11:03,654 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-21 20:11:03,654 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:11:03,658 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-21 20:11:03,658 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:11:03,658 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-21 20:11:03,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 20:11:03,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970263661 (current time:1689970263661). 2023-07-21 20:11:03,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:11:03,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x653b2a06 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:03,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dcd08f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:03,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:03,672 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:03,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x653b2a06 to 127.0.0.1:57298 2023-07-21 20:11:03,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:03,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x14ca1bdd to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:03,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@289d7858, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:03,679 DEBUG [hconnection-0x4d724f17-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:03,681 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:03,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:03,687 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:03,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14ca1bdd to 127.0.0.1:57298 2023-07-21 20:11:03,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:03,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 20:11:03,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:11:03,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 20:11:03,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 20:11:03,693 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 20:11:03,694 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689970863694 2023-07-21 20:11:03,694 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-21 20:11:03,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 20:11:03,695 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:11:03,695 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:11:03,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 20:11:03,697 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 20:11:03,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-21 20:11:03,699 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 20:11:03,699 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689970863699 2023-07-21 20:11:03,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,710 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-21 20:11:03,710 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:03,711 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-21 20:11:03,711 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-21 20:11:03,712 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,712 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,713 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:03,713 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:03,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:03,713 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:03,713 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:03,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:03,714 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,714 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,714 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,714 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:11:03,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 20:11:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,715 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 20:11:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 20:11:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 20:11:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,715 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 20:11:03,715 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 20:11:03,715 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 20:11:03,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,715 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:03,716 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 20:11:03,717 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 20:11:03,717 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 20:11:03,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,717 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 20:11:03,717 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 20:11:03,717 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:03,717 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:03,718 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 20:11:03,721 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 20:11:03,721 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 20:11:03,721 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 20:11:03,721 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 20:11:03,721 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 20:11:03,723 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,723 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:03,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:03,724 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,725 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,725 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:03,725 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,725 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,726 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:03,726 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:03,726 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,726 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:03,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:03,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:03,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-21 20:11:03,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19834006[Count = 1] remaining members to acquire global barrier 2023-07-21 20:11:03,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:03,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:03,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:03,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:03,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:03,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:03,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-21 20:11:03,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19834006[Count = 0] remaining members to acquire global barrier 2023-07-21 20:11:03,730 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-21 20:11:03,730 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,731 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,731 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,731 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,731 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,732 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 20:11:03,732 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 20:11:03,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,732 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,732 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:03,732 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:03,732 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:03,732 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:03,732 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:03,732 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. started... 2023-07-21 20:11:03,732 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:03,732 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:11:03,732 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 20:11:03,732 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 20:11:03,732 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. started... 2023-07-21 20:11:03,732 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38477,1689970216099' in zk 2023-07-21 20:11:03,733 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bd69656c28fbcccef25cd64999de66f8: 2023-07-21 20:11:03,734 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c51933bbe2433979ca6e99e10b74031b: 2023-07-21 20:11:03,734 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,734 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,735 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:03,735 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:03,735 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:11:03,735 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:11:03,740 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 20:11:03,740 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:03,740 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 20:11:03,764 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. completed. 2023-07-21 20:11:03,764 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:03,764 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:03,764 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. completed. 2023-07-21 20:11:03,764 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:03,764 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:03,764 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,764 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:03,764 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 20:11:03,764 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:03,764 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45843,1689970216044' in zk 2023-07-21 20:11:03,764 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,765 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 20:11:03,765 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39241,1689970215968' in zk 2023-07-21 20:11:03,766 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,766 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 20:11:03,766 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 20:11:03,766 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:03,766 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:03,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:03,766 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:03,767 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 20:11:03,768 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 20:11:03,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45843,1689970216044': 2023-07-21 20:11:03,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-21 20:11:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:03,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:03,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:03,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39241,1689970215968': 2023-07-21 20:11:03,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-21 20:11:03,779 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-21 20:11:03,779 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:11:03,779 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:11:03,779 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,779 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:11:03,781 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,781 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,781 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,781 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:03,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:03,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:03,781 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,781 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:03,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,781 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:03,781 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:03,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:03,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:03,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:03,782 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,783 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:03,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:03,784 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:03,785 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,785 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,789 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,789 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,789 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:03,789 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:03,789 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:03,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:03,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:03,789 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:03,789 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:03,789 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:03,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:03,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:03,789 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:03,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:03,789 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:03,789 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:03,791 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:03,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:03,789 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:03,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:03,791 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:03,791 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,792 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:03,792 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:03,792 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,792 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-21 20:11:03,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,796 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:03,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 20:11:03,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:03,798 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:11:03,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,868 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-21 20:11:03,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,868 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:03,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689970263694Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689970263791 (+97 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689970263791Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689970263795 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689970263815 (+20 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689970263868 (+53 ms) 2023-07-21 20:11:03,871 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 20:11:03,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 176 msec 2023-07-21 20:11:03,998 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:03,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 20:11:03,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:11:04,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45843] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:11:04,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:11:04,010 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-21 20:11:04,010 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:04,011 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:11:04,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 20:11:04,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970264021 (current time:1689970264021). 2023-07-21 20:11:04,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:11:04,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x28c546fb to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:04,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@598f3a87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:04,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:04,036 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:04,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28c546fb to 127.0.0.1:57298 2023-07-21 20:11:04,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:04,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x29009abd to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:04,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bf0f3f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:04,045 DEBUG [hconnection-0xb0baf03-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:04,048 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:04,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:04,052 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:04,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29009abd to 127.0.0.1:57298 2023-07-21 20:11:04,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:04,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 20:11:04,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:11:04,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 20:11:04,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 20:11:04,057 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 20:11:04,058 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689970864058 2023-07-21 20:11:04,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 20:11:04,058 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-21 20:11:04,059 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:11:04,059 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:11:04,060 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 20:11:04,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 20:11:04,061 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 4 msec 2023-07-21 20:11:04,062 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 20:11:04,063 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689970864063 2023-07-21 20:11:04,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-21 20:11:04,075 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-21 20:11:04,075 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:04,076 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-21 20:11:04,076 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-21 20:11:04,076 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,076 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,078 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,078 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,078 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,078 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,079 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,079 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 20:11:04,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,079 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,080 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:11:04,080 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 20:11:04,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 20:11:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,080 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 20:11:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 20:11:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 20:11:04,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 20:11:04,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 20:11:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 20:11:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 20:11:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:04,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 20:11:04,082 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 20:11:04,083 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 20:11:04,083 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:04,083 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 20:11:04,083 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 20:11:04,084 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 20:11:04,082 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 20:11:04,084 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 20:11:04,084 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 20:11:04,084 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 20:11:04,084 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 20:11:04,087 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,087 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:04,088 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,088 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,088 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:04,088 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,088 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:04,088 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:04,088 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:04,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-21 20:11:04,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cecbee5[Count = 1] remaining members to acquire global barrier 2023-07-21 20:11:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:04,090 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,091 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:04,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-21 20:11:04,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cecbee5[Count = 0] remaining members to acquire global barrier 2023-07-21 20:11:04,092 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-21 20:11:04,093 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,094 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,094 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,094 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,094 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 20:11:04,094 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 20:11:04,094 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,094 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 20:11:04,094 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 20:11:04,094 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38477,1689970216099' in zk 2023-07-21 20:11:04,094 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:04,094 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:04,094 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:04,094 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. started... 2023-07-21 20:11:04,094 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,095 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:11:04,095 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bd69656c28fbcccef25cd64999de66f8 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-21 20:11:04,096 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 20:11:04,096 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:04,096 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 20:11:04,099 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:04,099 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:04,099 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:04,100 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. started... 2023-07-21 20:11:04,100 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c51933bbe2433979ca6e99e10b74031b 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-21 20:11:04,127 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/.tmp/cf/403d35e9202d48698d7122f4439eeb27 2023-07-21 20:11:04,128 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/.tmp/cf/0fb6fc162bfa46bfb56307e1ff4d29d2 2023-07-21 20:11:04,133 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/.tmp/cf/403d35e9202d48698d7122f4439eeb27 as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/cf/403d35e9202d48698d7122f4439eeb27 2023-07-21 20:11:04,135 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/.tmp/cf/0fb6fc162bfa46bfb56307e1ff4d29d2 as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/cf/0fb6fc162bfa46bfb56307e1ff4d29d2 2023-07-21 20:11:04,139 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/cf/403d35e9202d48698d7122f4439eeb27, entries=45, sequenceid=6, filesize=7.9 K 2023-07-21 20:11:04,140 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/cf/0fb6fc162bfa46bfb56307e1ff4d29d2, entries=5, sequenceid=6, filesize=5.2 K 2023-07-21 20:11:04,140 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for bd69656c28fbcccef25cd64999de66f8 in 45ms, sequenceid=6, compaction requested=false 2023-07-21 20:11:04,140 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-21 20:11:04,145 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bd69656c28fbcccef25cd64999de66f8: 2023-07-21 20:11:04,145 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for c51933bbe2433979ca6e99e10b74031b in 45ms, sequenceid=6, compaction requested=false 2023-07-21 20:11:04,146 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c51933bbe2433979ca6e99e10b74031b: 2023-07-21 20:11:04,146 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 20:11:04,146 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:04,147 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 20:11:04,147 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/cf/403d35e9202d48698d7122f4439eeb27] hfiles 2023-07-21 20:11:04,147 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:04,147 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/cf/403d35e9202d48698d7122f4439eeb27 for snapshot=snaptb0-testConsecutiveExports 2023-07-21 20:11:04,147 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/cf/0fb6fc162bfa46bfb56307e1ff4d29d2] hfiles 2023-07-21 20:11:04,147 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/cf/0fb6fc162bfa46bfb56307e1ff4d29d2 for snapshot=snaptb0-testConsecutiveExports 2023-07-21 20:11:04,158 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. completed. 2023-07-21 20:11:04,159 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:04,159 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:04,159 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:04,159 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,159 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 20:11:04,159 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39241,1689970215968' in zk 2023-07-21 20:11:04,159 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:04,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 20:11:04,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:04,161 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:11:04,161 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. completed. 2023-07-21 20:11:04,161 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:04,161 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:04,161 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:04,161 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,161 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 20:11:04,161 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45843,1689970216044' in zk 2023-07-21 20:11:04,162 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,162 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 20:11:04,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:04,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:04,162 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:04,162 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 20:11:04,164 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:04,164 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 20:11:04,164 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:04,164 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 20:11:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39241,1689970215968': 2023-07-21 20:11:04,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-21 20:11:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:04,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:04,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:04,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:04,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:04,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:04,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45843,1689970216044': 2023-07-21 20:11:04,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-21 20:11:04,171 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-21 20:11:04,171 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:11:04,171 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:11:04,171 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-21 20:11:04,171 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:11:04,173 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,173 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,173 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:04,173 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,173 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:04,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,173 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:04,174 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:04,173 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:04,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:04,174 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:04,175 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:04,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,176 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:04,177 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 20:11:04,177 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:04,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,184 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,184 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,184 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,184 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,184 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:04,184 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,184 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,185 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-21 20:11:04,185 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:04,185 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-21 20:11:04,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:04,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:04,185 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:04,185 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,185 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:04,185 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:04,185 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,185 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,185 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:04,185 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:04,185 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:04,185 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:04,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:04,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:04,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:04,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:04,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:04,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:04,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,230 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-21 20:11:04,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,231 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689970264058Consolidate snapshot: snaptb0-testConsecutiveExports at 1689970264185 (+127 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689970264185Writing data manifest for snaptb0-testConsecutiveExports at 1689970264192 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689970264204 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689970264230 (+26 ms) 2023-07-21 20:11:04,236 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 20:11:04,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 178 msec 2023-07-21 20:11:04,361 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:04,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 20:11:04,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:11:04,362 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362 2023-07-21 20:11:04,363 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362, srcFsUri=hdfs://localhost:33875, srcDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:11:04,385 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:11:04,386 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@b93eb3c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,386 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091, snapshotDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-21 20:11:04,393 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:04,413 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:04,414 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:04,414 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:04,415 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:05,425 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-7144785052875533822.jar 2023-07-21 20:11:05,426 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:05,427 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:05,496 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-5840877569665513845.jar 2023-07-21 20:11:05,496 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:05,497 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:05,497 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:05,497 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:05,498 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:05,498 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:05,498 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:11:05,499 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:11:05,499 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:11:05,500 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:11:05,500 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:11:05,500 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:11:05,501 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:11:05,501 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:11:05,501 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:11:05,502 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:11:05,502 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:05,503 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:05,503 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:05,504 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:05,504 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:05,504 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:05,505 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:05,915 WARN [Listener at jenkins-hbase4.apache.org/33191] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:11:05,917 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-21 20:11:05,919 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 20:11:07,091 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:11:07,091 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:11:07,094 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0002_000001 (auth:SIMPLE) 2023-07-21 20:11:07,836 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0003_000001 (auth:SIMPLE) 2023-07-21 20:11:08,327 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:11:12,310 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0003_000001 (auth:SIMPLE) 2023-07-21 20:11:14,569 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0003_000001 (auth:SIMPLE) 2023-07-21 20:11:17,395 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0003_000001 (auth:SIMPLE) 2023-07-21 20:11:19,107 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:11:19,108 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:11:19,111 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-21 20:11:19,111 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:11:19,112 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:11:19,112 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1181763459_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 20:11:19,114 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 20:11:19,114 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 20:11:19,114 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6a840a7 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 20:11:19,115 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 20:11:19,115 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 20:11:19,116 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362, srcFsUri=hdfs://localhost:33875, srcDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:11:19,138 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:11:19,138 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3a404519, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:19,138 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091, snapshotDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-21 20:11:19,149 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 20:11:19,160 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:19,160 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:19,161 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:19,161 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,062 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-388655225849494563.jar 2023-07-21 20:11:20,062 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,063 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,130 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-4569106826215665265.jar 2023-07-21 20:11:20,131 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,131 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,132 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,132 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,132 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,133 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:20,133 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:11:20,133 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:11:20,134 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:11:20,134 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:11:20,134 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:11:20,135 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:11:20,135 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:11:20,136 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:11:20,136 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:11:20,137 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:11:20,137 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:20,138 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:20,139 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:20,139 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:20,139 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:20,140 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:20,140 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:21,017 WARN [Listener at jenkins-hbase4.apache.org/33191] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:11:21,020 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-21 20:11:21,022 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 20:11:23,570 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:11:23,570 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:11:23,572 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0003_000001 (auth:SIMPLE) 2023-07-21 20:11:24,106 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0004_000001 (auth:SIMPLE) 2023-07-21 20:11:28,952 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0004_000001 (auth:SIMPLE) 2023-07-21 20:11:31,169 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0004_000001 (auth:SIMPLE) 2023-07-21 20:11:34,524 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0004_000001 (auth:SIMPLE) 2023-07-21 20:11:36,277 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:11:36,278 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:11:36,281 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-21 20:11:36,281 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:11:36,281 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:11:36,281 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1181763459_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 20:11:36,284 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 20:11:36,284 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 20:11:36,284 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6a840a7 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 20:11:36,285 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 20:11:36,285 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/local-export-1689970264362/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 20:11:36,297 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-21 20:11:36,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-21 20:11:36,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:36,304 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970296304"}]},"ts":"1689970296304"} 2023-07-21 20:11:36,306 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-21 20:11:36,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 20:11:36,308 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-21 20:11:36,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c51933bbe2433979ca6e99e10b74031b, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bd69656c28fbcccef25cd64999de66f8, UNASSIGN}] 2023-07-21 20:11:36,312 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c51933bbe2433979ca6e99e10b74031b, UNASSIGN 2023-07-21 20:11:36,312 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bd69656c28fbcccef25cd64999de66f8, UNASSIGN 2023-07-21 20:11:36,313 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c51933bbe2433979ca6e99e10b74031b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:36,313 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=bd69656c28fbcccef25cd64999de66f8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:36,314 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970296313"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970296313"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970296313"}]},"ts":"1689970296313"} 2023-07-21 20:11:36,314 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970296313"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970296313"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970296313"}]},"ts":"1689970296313"} 2023-07-21 20:11:36,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure c51933bbe2433979ca6e99e10b74031b, server=jenkins-hbase4.apache.org,45843,1689970216044}] 2023-07-21 20:11:36,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure bd69656c28fbcccef25cd64999de66f8, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:11:36,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 20:11:36,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c51933bbe2433979ca6e99e10b74031b 2023-07-21 20:11:36,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c51933bbe2433979ca6e99e10b74031b, disabling compactions & flushes 2023-07-21 20:11:36,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:36,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:36,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. after waiting 0 ms 2023-07-21 20:11:36,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:36,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bd69656c28fbcccef25cd64999de66f8 2023-07-21 20:11:36,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bd69656c28fbcccef25cd64999de66f8, disabling compactions & flushes 2023-07-21 20:11:36,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:36,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:36,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. after waiting 0 ms 2023-07-21 20:11:36,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:36,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:11:36,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:36,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:11:36,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:36,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b. 2023-07-21 20:11:36,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8. 2023-07-21 20:11:36,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c51933bbe2433979ca6e99e10b74031b: 2023-07-21 20:11:36,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bd69656c28fbcccef25cd64999de66f8: 2023-07-21 20:11:36,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bd69656c28fbcccef25cd64999de66f8 2023-07-21 20:11:36,506 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=bd69656c28fbcccef25cd64999de66f8, regionState=CLOSED 2023-07-21 20:11:36,506 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970296506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970296506"}]},"ts":"1689970296506"} 2023-07-21 20:11:36,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c51933bbe2433979ca6e99e10b74031b 2023-07-21 20:11:36,508 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c51933bbe2433979ca6e99e10b74031b, regionState=CLOSED 2023-07-21 20:11:36,508 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689970296507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970296507"}]},"ts":"1689970296507"} 2023-07-21 20:11:36,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-21 20:11:36,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure bd69656c28fbcccef25cd64999de66f8, server=jenkins-hbase4.apache.org,39241,1689970215968 in 193 msec 2023-07-21 20:11:36,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-21 20:11:36,517 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure c51933bbe2433979ca6e99e10b74031b, server=jenkins-hbase4.apache.org,45843,1689970216044 in 197 msec 2023-07-21 20:11:36,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bd69656c28fbcccef25cd64999de66f8, UNASSIGN in 206 msec 2023-07-21 20:11:36,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-21 20:11:36,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c51933bbe2433979ca6e99e10b74031b, UNASSIGN in 207 msec 2023-07-21 20:11:36,520 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970296520"}]},"ts":"1689970296520"} 2023-07-21 20:11:36,523 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-21 20:11:36,526 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-21 20:11:36,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 231 msec 2023-07-21 20:11:36,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 20:11:36,612 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-21 20:11:36,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-21 20:11:36,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:36,621 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:36,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-21 20:11:36,622 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:36,627 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-21 20:11:36,639 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:36,639 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:36,639 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:36,639 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:36,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 20:11:36,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 20:11:36,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 20:11:36,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 20:11:36,642 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:36,643 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:36,643 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:36,643 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:36,643 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:36,643 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:36,643 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 20:11:36,643 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:36,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 20:11:36,646 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b 2023-07-21 20:11:36,651 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8 2023-07-21 20:11:36,661 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/recovered.edits] 2023-07-21 20:11:36,663 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/recovered.edits] 2023-07-21 20:11:36,676 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/cf/0fb6fc162bfa46bfb56307e1ff4d29d2 to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/cf/0fb6fc162bfa46bfb56307e1ff4d29d2 2023-07-21 20:11:36,686 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/recovered.edits/9.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b/recovered.edits/9.seqid 2023-07-21 20:11:36,687 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/cf/403d35e9202d48698d7122f4439eeb27 to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/cf/403d35e9202d48698d7122f4439eeb27 2023-07-21 20:11:36,687 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/c51933bbe2433979ca6e99e10b74031b 2023-07-21 20:11:36,692 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/recovered.edits/9.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8/recovered.edits/9.seqid 2023-07-21 20:11:36,693 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testConsecutiveExports/bd69656c28fbcccef25cd64999de66f8 2023-07-21 20:11:36,693 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-21 20:11:36,696 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:36,706 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-21 20:11:36,714 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-21 20:11:36,716 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:36,716 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-21 20:11:36,716 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970296716"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:36,716 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970296716"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:36,731 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 20:11:36,731 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c51933bbe2433979ca6e99e10b74031b, NAME => 'testtb-testConsecutiveExports,,1689970263044.c51933bbe2433979ca6e99e10b74031b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bd69656c28fbcccef25cd64999de66f8, NAME => 'testtb-testConsecutiveExports,1,1689970263044.bd69656c28fbcccef25cd64999de66f8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 20:11:36,731 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-21 20:11:36,731 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970296731"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:36,737 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-21 20:11:36,740 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 20:11:36,742 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 127 msec 2023-07-21 20:11:36,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 20:11:36,746 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-21 20:11:36,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-21 20:11:36,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-21 20:11:36,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-21 20:11:36,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-21 20:11:36,821 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=745 (was 762), OpenFileDescriptor=892 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=321 (was 298) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 185) - ProcessCount LEAK? -, AvailableMemoryMB=7214 (was 7418) 2023-07-21 20:11:36,821 WARN [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-21 20:11:36,849 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=892, MaxFileDescriptor=60000, SystemLoadAverage=321, ProcessCount=187, AvailableMemoryMB=7209 2023-07-21 20:11:36,849 WARN [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-21 20:11:36,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 20:11:36,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:36,856 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:11:36,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-21 20:11:36,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:11:36,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 20:11:36,871 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9 2023-07-21 20:11:36,872 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9 empty. 2023-07-21 20:11:36,873 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9 2023-07-21 20:11:36,874 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0 2023-07-21 20:11:36,875 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0 empty. 2023-07-21 20:11:36,876 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0 2023-07-21 20:11:36,876 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-21 20:11:36,929 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-21 20:11:36,930 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => a83344f9d3a55ddc01e0d1dae471ded9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:11:36,933 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5ac858e943ddbd91d332b085ecc8e0a0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:11:36,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 20:11:37,007 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:37,007 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing a83344f9d3a55ddc01e0d1dae471ded9, disabling compactions & flushes 2023-07-21 20:11:37,007 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:37,007 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:37,007 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. after waiting 0 ms 2023-07-21 20:11:37,007 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:37,007 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:37,007 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for a83344f9d3a55ddc01e0d1dae471ded9: 2023-07-21 20:11:37,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 20:11:37,427 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:37,427 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 5ac858e943ddbd91d332b085ecc8e0a0, disabling compactions & flushes 2023-07-21 20:11:37,427 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:37,427 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:37,427 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. after waiting 0 ms 2023-07-21 20:11:37,427 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:37,428 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:37,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 5ac858e943ddbd91d332b085ecc8e0a0: 2023-07-21 20:11:37,431 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:11:37,434 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970297434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970297434"}]},"ts":"1689970297434"} 2023-07-21 20:11:37,435 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970297434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970297434"}]},"ts":"1689970297434"} 2023-07-21 20:11:37,445 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:11:37,446 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:11:37,447 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970297446"}]},"ts":"1689970297446"} 2023-07-21 20:11:37,448 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-21 20:11:37,455 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:11:37,458 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:11:37,458 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:11:37,458 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:11:37,458 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:11:37,458 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a83344f9d3a55ddc01e0d1dae471ded9, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac858e943ddbd91d332b085ecc8e0a0, ASSIGN}] 2023-07-21 20:11:37,469 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac858e943ddbd91d332b085ecc8e0a0, ASSIGN 2023-07-21 20:11:37,470 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a83344f9d3a55ddc01e0d1dae471ded9, ASSIGN 2023-07-21 20:11:37,471 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac858e943ddbd91d332b085ecc8e0a0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39241,1689970215968; forceNewPlan=false, retain=false 2023-07-21 20:11:37,471 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a83344f9d3a55ddc01e0d1dae471ded9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38477,1689970216099; forceNewPlan=false, retain=false 2023-07-21 20:11:37,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 20:11:37,621 INFO [jenkins-hbase4:34903] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:11:37,624 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=5ac858e943ddbd91d332b085ecc8e0a0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:37,624 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=a83344f9d3a55ddc01e0d1dae471ded9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:37,624 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970297624"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970297624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970297624"}]},"ts":"1689970297624"} 2023-07-21 20:11:37,624 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970297624"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970297624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970297624"}]},"ts":"1689970297624"} 2023-07-21 20:11:37,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 5ac858e943ddbd91d332b085ecc8e0a0, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:11:37,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure a83344f9d3a55ddc01e0d1dae471ded9, server=jenkins-hbase4.apache.org,38477,1689970216099}] 2023-07-21 20:11:37,781 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:37,781 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 20:11:37,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:37,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5ac858e943ddbd91d332b085ecc8e0a0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 20:11:37,786 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 20:11:37,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. service=AccessControlService 2023-07-21 20:11:37,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:37,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 5ac858e943ddbd91d332b085ecc8e0a0 2023-07-21 20:11:37,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:37,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5ac858e943ddbd91d332b085ecc8e0a0 2023-07-21 20:11:37,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5ac858e943ddbd91d332b085ecc8e0a0 2023-07-21 20:11:37,811 INFO [StoreOpener-5ac858e943ddbd91d332b085ecc8e0a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5ac858e943ddbd91d332b085ecc8e0a0 2023-07-21 20:11:37,816 DEBUG [StoreOpener-5ac858e943ddbd91d332b085ecc8e0a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/cf 2023-07-21 20:11:37,816 DEBUG [StoreOpener-5ac858e943ddbd91d332b085ecc8e0a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/cf 2023-07-21 20:11:37,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:37,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a83344f9d3a55ddc01e0d1dae471ded9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 20:11:37,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. service=AccessControlService 2023-07-21 20:11:37,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:37,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a83344f9d3a55ddc01e0d1dae471ded9 2023-07-21 20:11:37,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:37,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a83344f9d3a55ddc01e0d1dae471ded9 2023-07-21 20:11:37,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a83344f9d3a55ddc01e0d1dae471ded9 2023-07-21 20:11:37,818 INFO [StoreOpener-5ac858e943ddbd91d332b085ecc8e0a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ac858e943ddbd91d332b085ecc8e0a0 columnFamilyName cf 2023-07-21 20:11:37,819 INFO [StoreOpener-5ac858e943ddbd91d332b085ecc8e0a0-1] regionserver.HStore(310): Store=5ac858e943ddbd91d332b085ecc8e0a0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:37,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0 2023-07-21 20:11:37,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0 2023-07-21 20:11:37,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5ac858e943ddbd91d332b085ecc8e0a0 2023-07-21 20:11:37,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:11:37,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5ac858e943ddbd91d332b085ecc8e0a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66351739, jitterRate=-0.011282041668891907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:37,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5ac858e943ddbd91d332b085ecc8e0a0: 2023-07-21 20:11:37,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0., pid=60, masterSystemTime=1689970297778 2023-07-21 20:11:37,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:37,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:37,830 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=5ac858e943ddbd91d332b085ecc8e0a0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:37,830 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970297829"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970297829"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970297829"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970297829"}]},"ts":"1689970297829"} 2023-07-21 20:11:37,831 INFO [StoreOpener-a83344f9d3a55ddc01e0d1dae471ded9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a83344f9d3a55ddc01e0d1dae471ded9 2023-07-21 20:11:37,832 DEBUG [StoreOpener-a83344f9d3a55ddc01e0d1dae471ded9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/cf 2023-07-21 20:11:37,832 DEBUG [StoreOpener-a83344f9d3a55ddc01e0d1dae471ded9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/cf 2023-07-21 20:11:37,833 INFO [StoreOpener-a83344f9d3a55ddc01e0d1dae471ded9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a83344f9d3a55ddc01e0d1dae471ded9 columnFamilyName cf 2023-07-21 20:11:37,834 INFO [StoreOpener-a83344f9d3a55ddc01e0d1dae471ded9-1] regionserver.HStore(310): Store=a83344f9d3a55ddc01e0d1dae471ded9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:37,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-21 20:11:37,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 5ac858e943ddbd91d332b085ecc8e0a0, server=jenkins-hbase4.apache.org,39241,1689970215968 in 207 msec 2023-07-21 20:11:37,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9 2023-07-21 20:11:37,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9 2023-07-21 20:11:37,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac858e943ddbd91d332b085ecc8e0a0, ASSIGN in 377 msec 2023-07-21 20:11:37,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a83344f9d3a55ddc01e0d1dae471ded9 2023-07-21 20:11:37,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:11:37,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a83344f9d3a55ddc01e0d1dae471ded9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59516672, jitterRate=-0.11313247680664062}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:37,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a83344f9d3a55ddc01e0d1dae471ded9: 2023-07-21 20:11:37,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9., pid=61, masterSystemTime=1689970297780 2023-07-21 20:11:37,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:37,858 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=a83344f9d3a55ddc01e0d1dae471ded9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:37,858 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970297858"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970297858"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970297858"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970297858"}]},"ts":"1689970297858"} 2023-07-21 20:11:37,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:37,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-21 20:11:37,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure a83344f9d3a55ddc01e0d1dae471ded9, server=jenkins-hbase4.apache.org,38477,1689970216099 in 234 msec 2023-07-21 20:11:37,866 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-21 20:11:37,866 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a83344f9d3a55ddc01e0d1dae471ded9, ASSIGN in 405 msec 2023-07-21 20:11:37,867 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:11:37,867 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970297867"}]},"ts":"1689970297867"} 2023-07-21 20:11:37,869 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-21 20:11:37,872 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:11:37,872 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-21 20:11:37,875 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 20:11:37,877 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:37,877 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:37,877 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:37,877 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:37,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:37,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:37,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:37,879 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:37,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 1.0280 sec 2023-07-21 20:11:37,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 20:11:37,973 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-21 20:11:37,973 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-21 20:11:37,973 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:11:37,980 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-21 20:11:37,980 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:11:37,980 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-21 20:11:37,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 20:11:37,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970297996 (current time:1689970297996). 2023-07-21 20:11:37,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:11:37,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x28aa3f60 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:38,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d5afda3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:38,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:38,034 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:38,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28aa3f60 to 127.0.0.1:57298 2023-07-21 20:11:38,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:38,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x39443977 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:38,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@406c5000, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:38,060 DEBUG [hconnection-0x4ad10a4b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:38,061 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:38,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:38,070 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:38,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39443977 to 127.0.0.1:57298 2023-07-21 20:11:38,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:38,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 20:11:38,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:11:38,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 20:11:38,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 20:11:38,077 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 20:11:38,081 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689970898081 2023-07-21 20:11:38,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 20:11:38,084 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:11:38,084 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:11:38,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 20:11:38,090 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 20:11:38,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 15 msec 2023-07-21 20:11:38,093 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 20:11:38,094 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689970898094 2023-07-21 20:11:38,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,128 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-21 20:11:38,128 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:38,130 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-21 20:11:38,130 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-21 20:11:38,131 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,131 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,132 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:38,132 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:38,132 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:38,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:38,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:38,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:38,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:38,132 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:38,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:38,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,133 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,133 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,134 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,134 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:11:38,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 20:11:38,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 20:11:38,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,134 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 20:11:38,134 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 20:11:38,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 20:11:38,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,135 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,135 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 20:11:38,135 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 20:11:38,135 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:38,135 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:38,135 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 20:11:38,137 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 20:11:38,137 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 20:11:38,136 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 20:11:38,138 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 20:11:38,138 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 20:11:38,137 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 20:11:38,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,138 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 20:11:38,138 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:38,139 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 20:11:38,139 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 20:11:38,140 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 20:11:38,141 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,141 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:38,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:38,141 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,143 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,143 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,144 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:38,143 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,144 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:38,144 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:38,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:38,144 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,144 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:38,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:38,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 20:11:38,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@191be819[Count = 1] remaining members to acquire global barrier 2023-07-21 20:11:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:38,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:38,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:38,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 20:11:38,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@191be819[Count = 0] remaining members to acquire global barrier 2023-07-21 20:11:38,150 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-21 20:11:38,150 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,151 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,151 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,151 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,152 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,152 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 20:11:38,152 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 20:11:38,152 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 20:11:38,152 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 20:11:38,152 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,152 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:11:38,152 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45843,1689970216044' in zk 2023-07-21 20:11:38,159 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:38,160 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:38,160 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:38,160 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. started... 2023-07-21 20:11:38,168 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:38,168 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5ac858e943ddbd91d332b085ecc8e0a0: 2023-07-21 20:11:38,168 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:38,168 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:38,168 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. started... 2023-07-21 20:11:38,168 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,168 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:38,170 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:11:38,170 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a83344f9d3a55ddc01e0d1dae471ded9: 2023-07-21 20:11:38,170 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,170 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:38,170 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:11:38,176 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 20:11:38,176 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:38,176 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 20:11:38,184 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:38,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 20:11:38,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:38,185 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:11:38,224 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. completed. 2023-07-21 20:11:38,224 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:38,224 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:38,224 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:38,224 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,224 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 20:11:38,224 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39241,1689970215968' in zk 2023-07-21 20:11:38,224 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. completed. 2023-07-21 20:11:38,224 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:38,225 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:38,225 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:38,225 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,225 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 20:11:38,225 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38477,1689970216099' in zk 2023-07-21 20:11:38,236 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 20:11:38,236 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,236 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:38,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:38,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:38,236 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 20:11:38,251 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 20:11:38,251 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,251 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:38,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:38,251 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 20:11:38,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:38,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:38,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39241,1689970215968': 2023-07-21 20:11:38,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-21 20:11:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:38,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:38,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38477,1689970216099': 2023-07-21 20:11:38,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-21 20:11:38,261 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-21 20:11:38,261 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:11:38,261 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:11:38,261 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,261 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:11:38,273 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,274 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,274 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:38,274 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,273 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,274 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:38,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,274 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:38,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:38,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:38,274 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:38,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:38,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,275 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,276 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,280 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:38,280 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,281 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,309 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,309 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:38,309 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:38,309 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:38,309 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,309 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:38,309 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:38,309 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:38,309 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,309 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:38,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:38,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:38,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:38,309 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:38,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:38,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:38,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,314 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,314 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,314 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,314 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,314 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,314 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,314 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,314 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:38,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:38,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:38,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:38,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:38,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:38,385 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:38,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 20:11:38,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:38,387 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:11:38,510 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-21 20:11:38,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,511 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689970298084Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689970298311 (+227 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689970298312 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689970298317 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689970298364 (+47 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689970298510 (+146 ms) 2023-07-21 20:11:38,514 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 20:11:38,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 429 msec 2023-07-21 20:11:38,687 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:38,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 20:11:38,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:11:38,701 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:38,708 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:38,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:11:38,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:11:38,713 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,713 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:38,715 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:11:38,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 20:11:38,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970298728 (current time:1689970298728). 2023-07-21 20:11:38,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:11:38,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x56dccf87 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:38,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d7e1980, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:38,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:38,750 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:38,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56dccf87 to 127.0.0.1:57298 2023-07-21 20:11:38,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:38,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x0a337c09 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:38,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3aa33a3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:38,792 DEBUG [hconnection-0x173c86f2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:38,796 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:38,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:38,808 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:38,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a337c09 to 127.0.0.1:57298 2023-07-21 20:11:38,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:38,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 20:11:38,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:11:38,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 20:11:38,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 20:11:38,816 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 20:11:38,817 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689970898817 2023-07-21 20:11:38,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 20:11:38,817 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,819 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:11:38,819 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:11:38,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 20:11:38,820 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 20:11:38,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-21 20:11:38,823 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 20:11:38,824 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689970898824 2023-07-21 20:11:38,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,843 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-21 20:11:38,843 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:38,845 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-21 20:11:38,845 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-21 20:11:38,846 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,846 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,862 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:38,862 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:38,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:38,862 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,862 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:38,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:38,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:38,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:38,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:38,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:38,863 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,863 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,864 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,864 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:11:38,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 20:11:38,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,864 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 20:11:38,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 20:11:38,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,865 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 20:11:38,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,865 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 20:11:38,865 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:38,867 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 20:11:38,867 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,867 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 20:11:38,868 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 20:11:38,868 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 20:11:38,868 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:38,869 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 20:11:38,870 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 20:11:38,870 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 20:11:38,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 20:11:38,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,871 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 20:11:38,872 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,872 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:38,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:38,873 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,873 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,874 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:38,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:38,874 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,874 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:38,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:38,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 20:11:38,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@118980ff[Count = 1] remaining members to acquire global barrier 2023-07-21 20:11:38,878 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,879 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 20:11:38,879 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:38,880 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 20:11:38,880 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 20:11:38,880 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 20:11:38,883 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,883 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:38,884 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,884 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:38,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:38,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:38,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:38,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:38,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 20:11:38,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@118980ff[Count = 0] remaining members to acquire global barrier 2023-07-21 20:11:38,887 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-21 20:11:38,888 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,889 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,889 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,889 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,889 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 20:11:38,889 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 20:11:38,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,890 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 20:11:38,890 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 20:11:38,890 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45843,1689970216044' in zk 2023-07-21 20:11:38,890 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:38,890 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:38,891 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:38,891 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:38,891 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. started... 2023-07-21 20:11:38,891 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:38,891 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:38,891 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. started... 2023-07-21 20:11:38,891 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5ac858e943ddbd91d332b085ecc8e0a0 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-21 20:11:38,891 INFO [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a83344f9d3a55ddc01e0d1dae471ded9 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-21 20:11:38,897 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,897 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 20:11:38,897 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:38,897 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 20:11:38,913 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:38,913 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:11:38,919 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:38,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 20:11:38,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:38,920 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:11:38,930 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/.tmp/cf/860adafbd39f4636a074f19294c4a79f 2023-07-21 20:11:38,932 INFO [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/.tmp/cf/46dc563e6b7747e38e32f463b7fd5305 2023-07-21 20:11:38,939 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/.tmp/cf/46dc563e6b7747e38e32f463b7fd5305 as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/cf/46dc563e6b7747e38e32f463b7fd5305 2023-07-21 20:11:38,942 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/.tmp/cf/860adafbd39f4636a074f19294c4a79f as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/cf/860adafbd39f4636a074f19294c4a79f 2023-07-21 20:11:38,949 INFO [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/cf/46dc563e6b7747e38e32f463b7fd5305, entries=3, sequenceid=6, filesize=5.0 K 2023-07-21 20:11:38,951 INFO [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for a83344f9d3a55ddc01e0d1dae471ded9 in 60ms, sequenceid=6, compaction requested=false 2023-07-21 20:11:38,951 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-21 20:11:38,951 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a83344f9d3a55ddc01e0d1dae471ded9: 2023-07-21 20:11:38,952 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,952 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:38,952 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/cf/46dc563e6b7747e38e32f463b7fd5305] hfiles 2023-07-21 20:11:38,952 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/cf/46dc563e6b7747e38e32f463b7fd5305 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,983 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/cf/860adafbd39f4636a074f19294c4a79f, entries=47, sequenceid=6, filesize=8.0 K 2023-07-21 20:11:38,985 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 5ac858e943ddbd91d332b085ecc8e0a0 in 94ms, sequenceid=6, compaction requested=false 2023-07-21 20:11:38,987 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. completed. 2023-07-21 20:11:38,987 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5ac858e943ddbd91d332b085ecc8e0a0: 2023-07-21 20:11:38,987 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:38,988 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:38,988 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:38,988 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:38,988 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:38,988 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 20:11:38,988 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38477,1689970216099' in zk 2023-07-21 20:11:38,988 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:38,988 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/cf/860adafbd39f4636a074f19294c4a79f] hfiles 2023-07-21 20:11:38,988 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/cf/860adafbd39f4636a074f19294c4a79f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 20:11:39,004 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:39,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:39,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:39,005 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 20:11:39,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:39,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:39,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:39,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:39,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:39,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38477,1689970216099': 2023-07-21 20:11:39,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-21 20:11:39,042 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. completed. 2023-07-21 20:11:39,042 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:39,042 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:39,042 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:39,042 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:39,042 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 20:11:39,042 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39241,1689970215968' in zk 2023-07-21 20:11:39,044 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 20:11:39,044 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:39,044 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 20:11:39,048 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:39,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:39,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:39,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:39,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:39,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39241,1689970215968': 2023-07-21 20:11:39,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-21 20:11:39,062 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-21 20:11:39,062 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:11:39,062 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:11:39,062 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,062 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:11:39,067 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,068 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,068 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:39,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,067 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,068 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:39,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,068 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,068 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:39,068 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:39,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:39,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,070 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,071 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:39,074 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:39,074 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:39,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,075 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:39,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:39,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:39,078 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:39,078 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:39,078 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:39,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:39,078 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:39,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:39,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:39,079 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:39,079 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,079 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,078 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:39,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:39,078 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:39,079 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:39,079 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:39,080 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:39,082 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:39,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:39,082 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:39,082 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,082 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:39,082 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,082 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,082 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:39,121 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:39,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 20:11:39,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:39,122 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:11:39,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,195 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-21 20:11:39,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,195 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:39,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689970298817Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689970299079 (+262 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689970299079Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689970299098 (+19 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689970299132 (+34 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689970299195 (+63 ms) 2023-07-21 20:11:39,199 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 20:11:39,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 380 msec 2023-07-21 20:11:39,422 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:39,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 20:11:39,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:11:39,453 DEBUG [Listener at jenkins-hbase4.apache.org/33191] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 20:11:39,457 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 20:11:39,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 20:11:39,459 DEBUG [Listener at jenkins-hbase4.apache.org/33191] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 20:11:39,464 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 20:11:39,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 20:11:39,464 DEBUG [Listener at jenkins-hbase4.apache.org/33191] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 20:11:39,466 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 20:11:39,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45843] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 20:11:39,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 20:11:39,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:39,470 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:11:39,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-21 20:11:39,471 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:11:39,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 20:11:39,474 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269 2023-07-21 20:11:39,474 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:39,474 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269 empty. 2023-07-21 20:11:39,475 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d empty. 2023-07-21 20:11:39,475 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269 2023-07-21 20:11:39,475 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:39,475 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-21 20:11:39,485 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-21 20:11:39,487 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 85cf7da35c21844518f440333118a269, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:11:39,487 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => ad21f9ca97924ff843e7d8ea61090a1d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:11:39,502 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:39,502 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 85cf7da35c21844518f440333118a269, disabling compactions & flushes 2023-07-21 20:11:39,502 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:39,502 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. 2023-07-21 20:11:39,502 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. 2023-07-21 20:11:39,502 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing ad21f9ca97924ff843e7d8ea61090a1d, disabling compactions & flushes 2023-07-21 20:11:39,502 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. after waiting 0 ms 2023-07-21 20:11:39,502 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. 2023-07-21 20:11:39,502 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. 2023-07-21 20:11:39,502 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. 2023-07-21 20:11:39,503 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 85cf7da35c21844518f440333118a269: 2023-07-21 20:11:39,503 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. 2023-07-21 20:11:39,503 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. after waiting 0 ms 2023-07-21 20:11:39,503 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. 2023-07-21 20:11:39,503 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. 2023-07-21 20:11:39,503 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for ad21f9ca97924ff843e7d8ea61090a1d: 2023-07-21 20:11:39,505 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:11:39,506 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970299506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970299506"}]},"ts":"1689970299506"} 2023-07-21 20:11:39,506 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970299506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970299506"}]},"ts":"1689970299506"} 2023-07-21 20:11:39,508 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:11:39,509 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:11:39,509 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970299509"}]},"ts":"1689970299509"} 2023-07-21 20:11:39,510 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-21 20:11:39,514 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:11:39,515 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:11:39,515 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:11:39,515 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:11:39,515 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:11:39,516 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85cf7da35c21844518f440333118a269, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad21f9ca97924ff843e7d8ea61090a1d, ASSIGN}] 2023-07-21 20:11:39,518 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85cf7da35c21844518f440333118a269, ASSIGN 2023-07-21 20:11:39,518 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad21f9ca97924ff843e7d8ea61090a1d, ASSIGN 2023-07-21 20:11:39,521 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85cf7da35c21844518f440333118a269, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45843,1689970216044; forceNewPlan=false, retain=false 2023-07-21 20:11:39,521 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad21f9ca97924ff843e7d8ea61090a1d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38477,1689970216099; forceNewPlan=false, retain=false 2023-07-21 20:11:39,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 20:11:39,671 INFO [jenkins-hbase4:34903] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:11:39,674 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=85cf7da35c21844518f440333118a269, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:39,674 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ad21f9ca97924ff843e7d8ea61090a1d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,674 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970299674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970299674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970299674"}]},"ts":"1689970299674"} 2023-07-21 20:11:39,674 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970299674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970299674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970299674"}]},"ts":"1689970299674"} 2023-07-21 20:11:39,676 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 85cf7da35c21844518f440333118a269, server=jenkins-hbase4.apache.org,45843,1689970216044}] 2023-07-21 20:11:39,677 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure ad21f9ca97924ff843e7d8ea61090a1d, server=jenkins-hbase4.apache.org,38477,1689970216099}] 2023-07-21 20:11:39,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 20:11:39,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. 2023-07-21 20:11:39,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 85cf7da35c21844518f440333118a269, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269.', STARTKEY => '', ENDKEY => '2'} 2023-07-21 20:11:39,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. 2023-07-21 20:11:39,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ad21f9ca97924ff843e7d8ea61090a1d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d.', STARTKEY => '2', ENDKEY => ''} 2023-07-21 20:11:39,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. service=AccessControlService 2023-07-21 20:11:39,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. service=AccessControlService 2023-07-21 20:11:39,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:39,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:39,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 85cf7da35c21844518f440333118a269 2023-07-21 20:11:39,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:39,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:39,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:39,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 85cf7da35c21844518f440333118a269 2023-07-21 20:11:39,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:39,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 85cf7da35c21844518f440333118a269 2023-07-21 20:11:39,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:39,839 INFO [StoreOpener-85cf7da35c21844518f440333118a269-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 85cf7da35c21844518f440333118a269 2023-07-21 20:11:39,840 INFO [StoreOpener-ad21f9ca97924ff843e7d8ea61090a1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:39,841 DEBUG [StoreOpener-85cf7da35c21844518f440333118a269-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/cf 2023-07-21 20:11:39,841 DEBUG [StoreOpener-85cf7da35c21844518f440333118a269-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/cf 2023-07-21 20:11:39,842 INFO [StoreOpener-85cf7da35c21844518f440333118a269-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85cf7da35c21844518f440333118a269 columnFamilyName cf 2023-07-21 20:11:39,842 DEBUG [StoreOpener-ad21f9ca97924ff843e7d8ea61090a1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/cf 2023-07-21 20:11:39,843 INFO [StoreOpener-85cf7da35c21844518f440333118a269-1] regionserver.HStore(310): Store=85cf7da35c21844518f440333118a269/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:39,843 DEBUG [StoreOpener-ad21f9ca97924ff843e7d8ea61090a1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/cf 2023-07-21 20:11:39,843 INFO [StoreOpener-ad21f9ca97924ff843e7d8ea61090a1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad21f9ca97924ff843e7d8ea61090a1d columnFamilyName cf 2023-07-21 20:11:39,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269 2023-07-21 20:11:39,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269 2023-07-21 20:11:39,844 INFO [StoreOpener-ad21f9ca97924ff843e7d8ea61090a1d-1] regionserver.HStore(310): Store=ad21f9ca97924ff843e7d8ea61090a1d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:39,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:39,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:39,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 85cf7da35c21844518f440333118a269 2023-07-21 20:11:39,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:39,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:11:39,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:11:39,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 85cf7da35c21844518f440333118a269; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59312321, jitterRate=-0.11617754399776459}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:39,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ad21f9ca97924ff843e7d8ea61090a1d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72537845, jitterRate=0.08089812099933624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:39,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 85cf7da35c21844518f440333118a269: 2023-07-21 20:11:39,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ad21f9ca97924ff843e7d8ea61090a1d: 2023-07-21 20:11:39,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d., pid=70, masterSystemTime=1689970299829 2023-07-21 20:11:39,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269., pid=69, masterSystemTime=1689970299829 2023-07-21 20:11:39,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. 2023-07-21 20:11:39,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. 2023-07-21 20:11:39,855 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ad21f9ca97924ff843e7d8ea61090a1d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:39,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. 2023-07-21 20:11:39,855 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970299855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970299855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970299855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970299855"}]},"ts":"1689970299855"} 2023-07-21 20:11:39,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. 2023-07-21 20:11:39,855 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=85cf7da35c21844518f440333118a269, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:39,856 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970299855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970299855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970299855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970299855"}]},"ts":"1689970299855"} 2023-07-21 20:11:39,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-21 20:11:39,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure ad21f9ca97924ff843e7d8ea61090a1d, server=jenkins-hbase4.apache.org,38477,1689970216099 in 180 msec 2023-07-21 20:11:39,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-21 20:11:39,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 85cf7da35c21844518f440333118a269, server=jenkins-hbase4.apache.org,45843,1689970216044 in 181 msec 2023-07-21 20:11:39,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad21f9ca97924ff843e7d8ea61090a1d, ASSIGN in 343 msec 2023-07-21 20:11:39,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-21 20:11:39,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85cf7da35c21844518f440333118a269, ASSIGN in 344 msec 2023-07-21 20:11:39,865 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:11:39,865 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970299865"}]},"ts":"1689970299865"} 2023-07-21 20:11:39,866 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-21 20:11:39,868 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:11:39,869 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-21 20:11:39,871 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-21 20:11:39,872 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:39,872 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:39,872 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:39,872 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:39,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:39,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:39,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:39,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:39,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:39,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:39,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:39,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:39,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 406 msec 2023-07-21 20:11:40,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 20:11:40,075 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-21 20:11:40,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 85cf7da35c21844518f440333118a269, ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:40,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85cf7da35c21844518f440333118a269, ad21f9ca97924ff843e7d8ea61090a1d], force=true 2023-07-21 20:11:40,119 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85cf7da35c21844518f440333118a269, ad21f9ca97924ff843e7d8ea61090a1d], force=true 2023-07-21 20:11:40,119 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85cf7da35c21844518f440333118a269, ad21f9ca97924ff843e7d8ea61090a1d], force=true 2023-07-21 20:11:40,119 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85cf7da35c21844518f440333118a269, ad21f9ca97924ff843e7d8ea61090a1d], force=true 2023-07-21 20:11:40,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 20:11:40,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85cf7da35c21844518f440333118a269, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad21f9ca97924ff843e7d8ea61090a1d, UNASSIGN}] 2023-07-21 20:11:40,146 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad21f9ca97924ff843e7d8ea61090a1d, UNASSIGN 2023-07-21 20:11:40,146 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85cf7da35c21844518f440333118a269, UNASSIGN 2023-07-21 20:11:40,147 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ad21f9ca97924ff843e7d8ea61090a1d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:40,147 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=85cf7da35c21844518f440333118a269, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:40,147 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970300147"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970300147"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970300147"}]},"ts":"1689970300147"} 2023-07-21 20:11:40,147 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970300147"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970300147"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970300147"}]},"ts":"1689970300147"} 2023-07-21 20:11:40,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure ad21f9ca97924ff843e7d8ea61090a1d, server=jenkins-hbase4.apache.org,38477,1689970216099}] 2023-07-21 20:11:40,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 85cf7da35c21844518f440333118a269, server=jenkins-hbase4.apache.org,45843,1689970216044}] 2023-07-21 20:11:40,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 20:11:40,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 85cf7da35c21844518f440333118a269 2023-07-21 20:11:40,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:40,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 85cf7da35c21844518f440333118a269, disabling compactions & flushes 2023-07-21 20:11:40,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ad21f9ca97924ff843e7d8ea61090a1d, disabling compactions & flushes 2023-07-21 20:11:40,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. 2023-07-21 20:11:40,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. 2023-07-21 20:11:40,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. 2023-07-21 20:11:40,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. 2023-07-21 20:11:40,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. after waiting 0 ms 2023-07-21 20:11:40,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. 2023-07-21 20:11:40,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. after waiting 0 ms 2023-07-21 20:11:40,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 85cf7da35c21844518f440333118a269 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-21 20:11:40,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. 2023-07-21 20:11:40,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ad21f9ca97924ff843e7d8ea61090a1d 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-21 20:11:40,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/.tmp/cf/070273bc29494c27b52bbb854a973acb 2023-07-21 20:11:40,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/.tmp/cf/d50eb1b2835d46a38f6afdf1fbb3d42a 2023-07-21 20:11:40,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/.tmp/cf/070273bc29494c27b52bbb854a973acb as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/cf/070273bc29494c27b52bbb854a973acb 2023-07-21 20:11:40,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/.tmp/cf/d50eb1b2835d46a38f6afdf1fbb3d42a as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/cf/d50eb1b2835d46a38f6afdf1fbb3d42a 2023-07-21 20:11:40,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/cf/070273bc29494c27b52bbb854a973acb, entries=1, sequenceid=5, filesize=4.7 K 2023-07-21 20:11:40,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ad21f9ca97924ff843e7d8ea61090a1d in 67ms, sequenceid=5, compaction requested=false 2023-07-21 20:11:40,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-21 20:11:40,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/cf/d50eb1b2835d46a38f6afdf1fbb3d42a, entries=1, sequenceid=5, filesize=4.7 K 2023-07-21 20:11:40,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 85cf7da35c21844518f440333118a269 in 80ms, sequenceid=5, compaction requested=false 2023-07-21 20:11:40,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-21 20:11:40,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:40,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d. 2023-07-21 20:11:40,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ad21f9ca97924ff843e7d8ea61090a1d: 2023-07-21 20:11:40,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-21 20:11:40,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:40,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269. 2023-07-21 20:11:40,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 85cf7da35c21844518f440333118a269: 2023-07-21 20:11:40,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:40,405 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ad21f9ca97924ff843e7d8ea61090a1d, regionState=CLOSED 2023-07-21 20:11:40,405 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970300405"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970300405"}]},"ts":"1689970300405"} 2023-07-21 20:11:40,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 85cf7da35c21844518f440333118a269 2023-07-21 20:11:40,407 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=85cf7da35c21844518f440333118a269, regionState=CLOSED 2023-07-21 20:11:40,407 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689970300407"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970300407"}]},"ts":"1689970300407"} 2023-07-21 20:11:40,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-21 20:11:40,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure ad21f9ca97924ff843e7d8ea61090a1d, server=jenkins-hbase4.apache.org,38477,1689970216099 in 255 msec 2023-07-21 20:11:40,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ad21f9ca97924ff843e7d8ea61090a1d, UNASSIGN in 266 msec 2023-07-21 20:11:40,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-21 20:11:40,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 85cf7da35c21844518f440333118a269, server=jenkins-hbase4.apache.org,45843,1689970216044 in 255 msec 2023-07-21 20:11:40,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-21 20:11:40,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85cf7da35c21844518f440333118a269, UNASSIGN in 271 msec 2023-07-21 20:11:40,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 20:11:40,555 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-21 20:11:40,558 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299467.85cf7da35c21844518f440333118a269.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:40,558 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689970299467.ad21f9ca97924ff843e7d8ea61090a1d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:40,558 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:40,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7223e764f517a2ec4631bdd3c47e419b, ASSIGN}] 2023-07-21 20:11:40,647 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7223e764f517a2ec4631bdd3c47e419b, ASSIGN 2023-07-21 20:11:40,648 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7223e764f517a2ec4631bdd3c47e419b, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45843,1689970216044; forceNewPlan=false, retain=false 2023-07-21 20:11:40,672 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0004_000001 (auth:SIMPLE) 2023-07-21 20:11:40,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 20:11:40,798 INFO [jenkins-hbase4:34903] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 20:11:40,800 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=7223e764f517a2ec4631bdd3c47e419b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:40,801 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689970300800"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970300800"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970300800"}]},"ts":"1689970300800"} 2023-07-21 20:11:40,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 7223e764f517a2ec4631bdd3c47e419b, server=jenkins-hbase4.apache.org,45843,1689970216044}] 2023-07-21 20:11:40,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b. 2023-07-21 20:11:40,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7223e764f517a2ec4631bdd3c47e419b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b.', STARTKEY => '', ENDKEY => ''} 2023-07-21 20:11:40,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b. service=AccessControlService 2023-07-21 20:11:40,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:11:40,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7223e764f517a2ec4631bdd3c47e419b 2023-07-21 20:11:40,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:40,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7223e764f517a2ec4631bdd3c47e419b 2023-07-21 20:11:40,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7223e764f517a2ec4631bdd3c47e419b 2023-07-21 20:11:40,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/.regioninfo 2023-07-21 20:11:40,982 INFO [StoreOpener-7223e764f517a2ec4631bdd3c47e419b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7223e764f517a2ec4631bdd3c47e419b 2023-07-21 20:11:40,983 DEBUG [StoreOpener-7223e764f517a2ec4631bdd3c47e419b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/cf 2023-07-21 20:11:40,983 DEBUG [StoreOpener-7223e764f517a2ec4631bdd3c47e419b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/cf 2023-07-21 20:11:40,983 INFO [StoreOpener-7223e764f517a2ec4631bdd3c47e419b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7223e764f517a2ec4631bdd3c47e419b columnFamilyName cf 2023-07-21 20:11:41,012 DEBUG [StoreOpener-7223e764f517a2ec4631bdd3c47e419b-1] regionserver.HStore(539): loaded hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/cf/070273bc29494c27b52bbb854a973acb.ad21f9ca97924ff843e7d8ea61090a1d->hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/cf/070273bc29494c27b52bbb854a973acb-top 2023-07-21 20:11:41,035 DEBUG [StoreOpener-7223e764f517a2ec4631bdd3c47e419b-1] regionserver.HStore(539): loaded hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/cf/d50eb1b2835d46a38f6afdf1fbb3d42a.85cf7da35c21844518f440333118a269->hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/cf/d50eb1b2835d46a38f6afdf1fbb3d42a-top 2023-07-21 20:11:41,035 INFO [StoreOpener-7223e764f517a2ec4631bdd3c47e419b-1] regionserver.HStore(310): Store=7223e764f517a2ec4631bdd3c47e419b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:11:41,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b 2023-07-21 20:11:41,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b 2023-07-21 20:11:41,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7223e764f517a2ec4631bdd3c47e419b 2023-07-21 20:11:41,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7223e764f517a2ec4631bdd3c47e419b; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59207723, jitterRate=-0.11773617565631866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:11:41,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7223e764f517a2ec4631bdd3c47e419b: 2023-07-21 20:11:41,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b., pid=77, masterSystemTime=1689970300955 2023-07-21 20:11:41,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b.,because compaction is disabled. 2023-07-21 20:11:41,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b. 2023-07-21 20:11:41,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b. 2023-07-21 20:11:41,049 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=7223e764f517a2ec4631bdd3c47e419b, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,049 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689970301049"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970301049"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970301049"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970301049"}]},"ts":"1689970301049"} 2023-07-21 20:11:41,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-21 20:11:41,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 7223e764f517a2ec4631bdd3c47e419b, server=jenkins-hbase4.apache.org,45843,1689970216044 in 248 msec 2023-07-21 20:11:41,054 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-21 20:11:41,054 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7223e764f517a2ec4631bdd3c47e419b, ASSIGN in 409 msec 2023-07-21 20:11:41,056 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85cf7da35c21844518f440333118a269, ad21f9ca97924ff843e7d8ea61090a1d], force=true in 944 msec 2023-07-21 20:11:41,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 20:11:41,229 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-21 20:11:41,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 20:11:41,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970301229 (current time:1689970301229). 2023-07-21 20:11:41,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:11:41,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x4304c814 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:41,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ef86819, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:41,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:41,248 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:41,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4304c814 to 127.0.0.1:57298 2023-07-21 20:11:41,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:41,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x60969764 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:11:41,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@537b70a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:11:41,260 DEBUG [hconnection-0x68e2bf15-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:41,264 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:41,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:11:41,276 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:11:41,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60969764 to 127.0.0.1:57298 2023-07-21 20:11:41,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:11:41,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-21 20:11:41,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:11:41,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 20:11:41,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 20:11:41,282 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 20:11:41,283 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689970901283 2023-07-21 20:11:41,283 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 20:11:41,286 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:11:41,287 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:11:41,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 20:11:41,288 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 20:11:41,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-21 20:11:41,290 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 20:11:41,291 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689970901291 2023-07-21 20:11:41,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,305 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-21 20:11:41,305 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:41,307 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-21 20:11:41,307 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-21 20:11:41,307 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,307 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,309 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:41,309 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:41,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:41,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:41,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:41,309 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:41,309 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:41,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:41,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:41,309 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,310 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:11:41,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 20:11:41,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 20:11:41,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 20:11:41,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 20:11:41,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 20:11:41,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 20:11:41,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,311 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 20:11:41,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,311 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:41,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,312 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 20:11:41,312 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 20:11:41,311 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 20:11:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 20:11:41,314 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 20:11:41,314 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 20:11:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:11:41,314 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 20:11:41,314 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 20:11:41,315 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 20:11:41,315 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 20:11:41,315 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 20:11:41,317 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,317 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:41,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:41,317 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,318 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,318 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,318 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:41,318 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,319 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:41,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:41,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:41,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:41,319 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,320 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:11:41,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:41,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:41,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-21 20:11:41,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@120961b8[Count = 0] remaining members to acquire global barrier 2023-07-21 20:11:41,321 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-21 20:11:41,321 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,322 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,322 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,322 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,323 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,323 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 20:11:41,323 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:11:41,323 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 20:11:41,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,323 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 20:11:41,323 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 20:11:41,323 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38477,1689970216099' in zk 2023-07-21 20:11:41,323 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39241,1689970215968' in zk 2023-07-21 20:11:41,323 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 20:11:41,323 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:11:41,323 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:11:41,323 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b. 2023-07-21 20:11:41,324 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b. started... 2023-07-21 20:11:41,325 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7223e764f517a2ec4631bdd3c47e419b: 2023-07-21 20:11:41,325 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 20:11:41,325 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,325 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:41,325 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:11:41,325 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 20:11:41,326 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/cf/070273bc29494c27b52bbb854a973acb.ad21f9ca97924ff843e7d8ea61090a1d->hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/cf/070273bc29494c27b52bbb854a973acb-top, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/cf/d50eb1b2835d46a38f6afdf1fbb3d42a.85cf7da35c21844518f440333118a269->hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/cf/d50eb1b2835d46a38f6afdf1fbb3d42a-top] hfiles 2023-07-21 20:11:41,327 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/cf/070273bc29494c27b52bbb854a973acb.ad21f9ca97924ff843e7d8ea61090a1d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,327 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/cf/d50eb1b2835d46a38f6afdf1fbb3d42a.85cf7da35c21844518f440333118a269 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,330 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 20:11:41,331 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:41,331 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 20:11:41,344 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b. completed. 2023-07-21 20:11:41,344 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b. 2023-07-21 20:11:41,344 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:11:41,344 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:11:41,344 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,344 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 20:11:41,344 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45843,1689970216044' in zk 2023-07-21 20:11:41,354 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 20:11:41,354 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,354 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:41,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:41,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:41,354 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 20:11:41,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:41,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:41,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45843,1689970216044': 2023-07-21 20:11:41,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-21 20:11:41,358 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-21 20:11:41,358 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:11:41,358 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:11:41,358 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,358 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:11:41,361 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,361 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,361 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:41,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,361 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,361 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,361 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:11:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:11:41,361 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,361 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:41,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:11:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,362 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:41,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,362 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:11:41,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,364 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:11:41,365 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:41,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,365 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,368 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,368 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,369 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:41,369 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:41,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:41,369 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:41,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:41,369 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:41,369 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:11:41,369 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:11:41,369 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:11:41,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,369 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:41,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:41,369 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:41,369 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,370 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:41,370 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:11:41,369 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:11:41,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:41,370 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:41,370 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:41,370 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,370 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:11:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:11:41,387 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:41,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 20:11:41,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:11:41,388 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:11:41,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,448 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-21 20:11:41,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,448 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689970301283Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689970301369 (+86 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689970301369Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689970301373 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689970301387 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689970301448 (+61 ms) 2023-07-21 20:11:41,452 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 20:11:41,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 166 msec 2023-07-21 20:11:41,588 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:11:41,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 20:11:41,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:11:41,590 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970301590 2023-07-21 20:11:41,590 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33875, tgtDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970301590, rawTgtDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970301590, srcFsUri=hdfs://localhost:33875, srcDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:11:41,626 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:11:41,626 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_575547568_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970301590, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970301590/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,626 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091, snapshotDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-21 20:11:41,638 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970301590/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:41,668 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:41,668 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:41,669 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:41,669 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:42,090 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:11:42,749 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-4693006575594556470.jar 2023-07-21 20:11:42,749 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:42,750 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:42,821 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-7881503388790603440.jar 2023-07-21 20:11:42,822 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:42,822 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:42,822 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:42,823 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:42,823 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:42,824 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:11:42,824 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:11:42,825 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:11:42,825 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:11:42,826 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:11:42,826 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:11:42,827 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:11:42,827 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:11:42,827 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:11:42,828 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:11:42,828 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:11:42,829 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:42,829 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:42,830 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:42,830 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:42,830 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:11:42,831 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:42,832 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:11:44,205 WARN [Listener at jenkins-hbase4.apache.org/33191] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:11:44,208 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-21 20:11:44,210 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-21 20:11:44,299 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:11:44,299 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:11:44,595 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0005_000001 (auth:SIMPLE) 2023-07-21 20:11:50,297 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0005_000001 (auth:SIMPLE) 2023-07-21 20:11:52,649 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0005_000001 (auth:SIMPLE) 2023-07-21 20:11:56,836 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0005_000001 (auth:SIMPLE) 2023-07-21 20:11:58,664 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:11:58,672 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:11:58,694 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:58,694 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:11:58,695 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:11:58,695 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1181763459_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:58,695 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-21 20:11:58,696 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-21 20:11:58,696 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1181763459_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970301590/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970301590/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:58,696 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970301590/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-21 20:11:58,696 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970301590/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-21 20:11:58,704 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:58,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:58,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:58,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 20:11:58,710 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970318710"}]},"ts":"1689970318710"} 2023-07-21 20:11:58,712 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-21 20:11:58,713 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-21 20:11:58,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7223e764f517a2ec4631bdd3c47e419b, UNASSIGN}] 2023-07-21 20:11:58,716 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7223e764f517a2ec4631bdd3c47e419b, UNASSIGN 2023-07-21 20:11:58,718 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=7223e764f517a2ec4631bdd3c47e419b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:58,719 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689970318718"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970318718"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970318718"}]},"ts":"1689970318718"} 2023-07-21 20:11:58,720 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 7223e764f517a2ec4631bdd3c47e419b, server=jenkins-hbase4.apache.org,45843,1689970216044}] 2023-07-21 20:11:58,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 20:11:58,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7223e764f517a2ec4631bdd3c47e419b 2023-07-21 20:11:58,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7223e764f517a2ec4631bdd3c47e419b, disabling compactions & flushes 2023-07-21 20:11:58,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b. 2023-07-21 20:11:58,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b. 2023-07-21 20:11:58,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b. after waiting 0 ms 2023-07-21 20:11:58,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b. 2023-07-21 20:11:58,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-21 20:11:58,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:58,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b. 2023-07-21 20:11:58,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7223e764f517a2ec4631bdd3c47e419b: 2023-07-21 20:11:58,895 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=7223e764f517a2ec4631bdd3c47e419b, regionState=CLOSED 2023-07-21 20:11:58,895 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689970318895"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970318895"}]},"ts":"1689970318895"} 2023-07-21 20:11:58,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7223e764f517a2ec4631bdd3c47e419b 2023-07-21 20:11:58,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-21 20:11:58,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 7223e764f517a2ec4631bdd3c47e419b, server=jenkins-hbase4.apache.org,45843,1689970216044 in 177 msec 2023-07-21 20:11:58,901 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-21 20:11:58,901 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7223e764f517a2ec4631bdd3c47e419b, UNASSIGN in 185 msec 2023-07-21 20:11:58,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970318902"}]},"ts":"1689970318902"} 2023-07-21 20:11:58,911 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-21 20:11:58,913 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-21 20:11:58,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 208 msec 2023-07-21 20:11:59,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 20:11:59,013 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-21 20:11:59,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,022 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,024 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,031 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,036 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,036 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,036 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,036 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,037 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 20:11:59,037 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 20:11:59,037 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 20:11:59,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 20:11:59,040 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,040 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,040 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:59,040 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:59,041 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,041 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:59,041 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,041 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:59,042 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:59,042 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:59,042 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:59,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 20:11:59,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-21 20:11:59,046 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b 2023-07-21 20:11:59,047 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:59,047 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269 2023-07-21 20:11:59,049 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/recovered.edits] 2023-07-21 20:11:59,049 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/recovered.edits] 2023-07-21 20:11:59,051 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/recovered.edits] 2023-07-21 20:11:59,055 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/cf/070273bc29494c27b52bbb854a973acb to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/cf/070273bc29494c27b52bbb854a973acb 2023-07-21 20:11:59,057 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/cf/070273bc29494c27b52bbb854a973acb.ad21f9ca97924ff843e7d8ea61090a1d to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/cf/070273bc29494c27b52bbb854a973acb.ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:59,060 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/cf/d50eb1b2835d46a38f6afdf1fbb3d42a.85cf7da35c21844518f440333118a269 to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/cf/d50eb1b2835d46a38f6afdf1fbb3d42a.85cf7da35c21844518f440333118a269 2023-07-21 20:11:59,061 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/cf/d50eb1b2835d46a38f6afdf1fbb3d42a to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/cf/d50eb1b2835d46a38f6afdf1fbb3d42a 2023-07-21 20:11:59,061 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/recovered.edits/8.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d/recovered.edits/8.seqid 2023-07-21 20:11:59,062 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ad21f9ca97924ff843e7d8ea61090a1d 2023-07-21 20:11:59,065 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/recovered.edits/12.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b/recovered.edits/12.seqid 2023-07-21 20:11:59,066 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7223e764f517a2ec4631bdd3c47e419b 2023-07-21 20:11:59,067 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/recovered.edits/8.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269/recovered.edits/8.seqid 2023-07-21 20:11:59,068 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85cf7da35c21844518f440333118a269 2023-07-21 20:11:59,068 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-21 20:11:59,071 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,088 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-21 20:11:59,093 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-21 20:11:59,094 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,094 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-21 20:11:59,095 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970319094"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:59,107 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-21 20:11:59,107 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7223e764f517a2ec4631bdd3c47e419b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689970299468.7223e764f517a2ec4631bdd3c47e419b.', STARTKEY => '', ENDKEY => ''}] 2023-07-21 20:11:59,107 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-21 20:11:59,107 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970319107"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:59,111 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-21 20:11:59,119 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 105 msec 2023-07-21 20:11:59,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-21 20:11:59,144 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-21 20:11:59,145 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 20:11:59,151 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970319151"}]},"ts":"1689970319151"} 2023-07-21 20:11:59,159 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-21 20:11:59,161 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-21 20:11:59,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a83344f9d3a55ddc01e0d1dae471ded9, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac858e943ddbd91d332b085ecc8e0a0, UNASSIGN}] 2023-07-21 20:11:59,165 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac858e943ddbd91d332b085ecc8e0a0, UNASSIGN 2023-07-21 20:11:59,165 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a83344f9d3a55ddc01e0d1dae471ded9, UNASSIGN 2023-07-21 20:11:59,166 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=a83344f9d3a55ddc01e0d1dae471ded9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:11:59,166 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=5ac858e943ddbd91d332b085ecc8e0a0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:59,166 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970319166"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970319166"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970319166"}]},"ts":"1689970319166"} 2023-07-21 20:11:59,166 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970319166"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970319166"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970319166"}]},"ts":"1689970319166"} 2023-07-21 20:11:59,169 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure a83344f9d3a55ddc01e0d1dae471ded9, server=jenkins-hbase4.apache.org,38477,1689970216099}] 2023-07-21 20:11:59,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 5ac858e943ddbd91d332b085ecc8e0a0, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:11:59,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 20:11:59,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5ac858e943ddbd91d332b085ecc8e0a0 2023-07-21 20:11:59,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5ac858e943ddbd91d332b085ecc8e0a0, disabling compactions & flushes 2023-07-21 20:11:59,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:59,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:59,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. after waiting 0 ms 2023-07-21 20:11:59,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:59,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:11:59,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:59,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0. 2023-07-21 20:11:59,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5ac858e943ddbd91d332b085ecc8e0a0: 2023-07-21 20:11:59,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5ac858e943ddbd91d332b085ecc8e0a0 2023-07-21 20:11:59,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a83344f9d3a55ddc01e0d1dae471ded9 2023-07-21 20:11:59,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a83344f9d3a55ddc01e0d1dae471ded9, disabling compactions & flushes 2023-07-21 20:11:59,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:59,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:59,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. after waiting 0 ms 2023-07-21 20:11:59,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:59,354 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=5ac858e943ddbd91d332b085ecc8e0a0, regionState=CLOSED 2023-07-21 20:11:59,355 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970319354"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970319354"}]},"ts":"1689970319354"} 2023-07-21 20:11:59,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-21 20:11:59,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 5ac858e943ddbd91d332b085ecc8e0a0, server=jenkins-hbase4.apache.org,39241,1689970215968 in 182 msec 2023-07-21 20:11:59,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=5ac858e943ddbd91d332b085ecc8e0a0, UNASSIGN in 197 msec 2023-07-21 20:11:59,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:11:59,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:11:59,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9. 2023-07-21 20:11:59,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a83344f9d3a55ddc01e0d1dae471ded9: 2023-07-21 20:11:59,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a83344f9d3a55ddc01e0d1dae471ded9 2023-07-21 20:11:59,380 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=a83344f9d3a55ddc01e0d1dae471ded9, regionState=CLOSED 2023-07-21 20:11:59,380 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689970319380"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970319380"}]},"ts":"1689970319380"} 2023-07-21 20:11:59,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-21 20:11:59,386 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure a83344f9d3a55ddc01e0d1dae471ded9, server=jenkins-hbase4.apache.org,38477,1689970216099 in 213 msec 2023-07-21 20:11:59,390 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-21 20:11:59,390 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a83344f9d3a55ddc01e0d1dae471ded9, UNASSIGN in 224 msec 2023-07-21 20:11:59,391 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970319391"}]},"ts":"1689970319391"} 2023-07-21 20:11:59,392 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-21 20:11:59,400 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-21 20:11:59,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 255 msec 2023-07-21 20:11:59,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 20:11:59,454 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-21 20:11:59,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,459 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,460 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,461 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,465 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,466 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,466 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,466 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 20:11:59,466 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 20:11:59,467 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 20:11:59,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 20:11:59,469 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,469 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:59,469 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,470 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:59,469 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,470 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:59,470 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,470 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:11:59,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 20:11:59,475 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9 2023-07-21 20:11:59,475 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0 2023-07-21 20:11:59,478 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/recovered.edits] 2023-07-21 20:11:59,478 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/recovered.edits] 2023-07-21 20:11:59,489 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/cf/46dc563e6b7747e38e32f463b7fd5305 to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/cf/46dc563e6b7747e38e32f463b7fd5305 2023-07-21 20:11:59,490 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/cf/860adafbd39f4636a074f19294c4a79f to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/cf/860adafbd39f4636a074f19294c4a79f 2023-07-21 20:11:59,496 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/recovered.edits/9.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0/recovered.edits/9.seqid 2023-07-21 20:11:59,496 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/recovered.edits/9.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9/recovered.edits/9.seqid 2023-07-21 20:11:59,497 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/5ac858e943ddbd91d332b085ecc8e0a0 2023-07-21 20:11:59,497 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a83344f9d3a55ddc01e0d1dae471ded9 2023-07-21 20:11:59,497 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-21 20:11:59,500 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,502 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-21 20:11:59,504 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-21 20:11:59,505 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,505 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-21 20:11:59,506 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970319505"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:59,506 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970319505"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:59,507 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 20:11:59,507 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a83344f9d3a55ddc01e0d1dae471ded9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689970296851.a83344f9d3a55ddc01e0d1dae471ded9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5ac858e943ddbd91d332b085ecc8e0a0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689970296851.5ac858e943ddbd91d332b085ecc8e0a0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 20:11:59,507 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-21 20:11:59,507 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970319507"}]},"ts":"9223372036854775807"} 2023-07-21 20:11:59,508 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-21 20:11:59,512 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 57 msec 2023-07-21 20:11:59,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 20:11:59,572 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-21 20:11:59,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-21 20:11:59,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-21 20:11:59,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 20:11:59,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-21 20:11:59,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 20:11:59,622 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 745) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:59338 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1865272629_1 at /127.0.0.1:53622 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3951 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:48362 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:53654 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:59332 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:37769 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=903 (was 892) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=405 (was 321) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 187) - ProcessCount LEAK? -, AvailableMemoryMB=6253 (was 7209) 2023-07-21 20:11:59,622 WARN [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-21 20:11:59,647 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=405, ProcessCount=190, AvailableMemoryMB=6251 2023-07-21 20:11:59,647 WARN [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-21 20:11:59,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 20:11:59,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:11:59,653 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:11:59,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-21 20:11:59,654 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:11:59,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 20:11:59,657 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3 2023-07-21 20:11:59,657 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a 2023-07-21 20:11:59,657 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a empty. 2023-07-21 20:11:59,658 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3 empty. 2023-07-21 20:11:59,662 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a 2023-07-21 20:11:59,662 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3 2023-07-21 20:11:59,663 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-21 20:11:59,694 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-21 20:11:59,696 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b637e0f476b878b3ffec2abf620c7df3, NAME => 'testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:11:59,699 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f256fb3d372f3120ca52ea1621fa197a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:11:59,735 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:59,735 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f256fb3d372f3120ca52ea1621fa197a, disabling compactions & flushes 2023-07-21 20:11:59,735 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:11:59,735 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:11:59,735 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. after waiting 0 ms 2023-07-21 20:11:59,736 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:11:59,736 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:11:59,736 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f256fb3d372f3120ca52ea1621fa197a: 2023-07-21 20:11:59,739 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:11:59,740 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b637e0f476b878b3ffec2abf620c7df3, disabling compactions & flushes 2023-07-21 20:11:59,740 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:11:59,740 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:11:59,740 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. after waiting 0 ms 2023-07-21 20:11:59,740 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:11:59,740 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:11:59,740 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b637e0f476b878b3ffec2abf620c7df3: 2023-07-21 20:11:59,742 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:11:59,743 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970319743"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970319743"}]},"ts":"1689970319743"} 2023-07-21 20:11:59,744 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970319743"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970319743"}]},"ts":"1689970319743"} 2023-07-21 20:11:59,746 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:11:59,746 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:11:59,747 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970319747"}]},"ts":"1689970319747"} 2023-07-21 20:11:59,748 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-21 20:11:59,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:11:59,753 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:11:59,753 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:11:59,753 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:11:59,753 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:11:59,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b637e0f476b878b3ffec2abf620c7df3, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f256fb3d372f3120ca52ea1621fa197a, ASSIGN}] 2023-07-21 20:11:59,756 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f256fb3d372f3120ca52ea1621fa197a, ASSIGN 2023-07-21 20:11:59,756 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b637e0f476b878b3ffec2abf620c7df3, ASSIGN 2023-07-21 20:11:59,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 20:11:59,757 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f256fb3d372f3120ca52ea1621fa197a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39241,1689970215968; forceNewPlan=false, retain=false 2023-07-21 20:11:59,757 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b637e0f476b878b3ffec2abf620c7df3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45843,1689970216044; forceNewPlan=false, retain=false 2023-07-21 20:11:59,907 INFO [jenkins-hbase4:34903] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:11:59,911 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b637e0f476b878b3ffec2abf620c7df3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:11:59,911 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f256fb3d372f3120ca52ea1621fa197a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:11:59,911 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970319911"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970319911"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970319911"}]},"ts":"1689970319911"} 2023-07-21 20:11:59,911 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970319911"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970319911"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970319911"}]},"ts":"1689970319911"} 2023-07-21 20:11:59,913 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure b637e0f476b878b3ffec2abf620c7df3, server=jenkins-hbase4.apache.org,45843,1689970216044}] 2023-07-21 20:11:59,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure f256fb3d372f3120ca52ea1621fa197a, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:11:59,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 20:12:00,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:12:00,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f256fb3d372f3120ca52ea1621fa197a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 20:12:00,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. service=AccessControlService 2023-07-21 20:12:00,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:12:00,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f256fb3d372f3120ca52ea1621fa197a 2023-07-21 20:12:00,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:00,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f256fb3d372f3120ca52ea1621fa197a 2023-07-21 20:12:00,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f256fb3d372f3120ca52ea1621fa197a 2023-07-21 20:12:00,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:12:00,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b637e0f476b878b3ffec2abf620c7df3, NAME => 'testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 20:12:00,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. service=AccessControlService 2023-07-21 20:12:00,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:12:00,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState b637e0f476b878b3ffec2abf620c7df3 2023-07-21 20:12:00,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:00,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b637e0f476b878b3ffec2abf620c7df3 2023-07-21 20:12:00,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b637e0f476b878b3ffec2abf620c7df3 2023-07-21 20:12:00,081 INFO [StoreOpener-f256fb3d372f3120ca52ea1621fa197a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f256fb3d372f3120ca52ea1621fa197a 2023-07-21 20:12:00,087 INFO [StoreOpener-b637e0f476b878b3ffec2abf620c7df3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b637e0f476b878b3ffec2abf620c7df3 2023-07-21 20:12:00,090 DEBUG [StoreOpener-f256fb3d372f3120ca52ea1621fa197a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/cf 2023-07-21 20:12:00,090 DEBUG [StoreOpener-f256fb3d372f3120ca52ea1621fa197a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/cf 2023-07-21 20:12:00,091 INFO [StoreOpener-f256fb3d372f3120ca52ea1621fa197a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f256fb3d372f3120ca52ea1621fa197a columnFamilyName cf 2023-07-21 20:12:00,093 DEBUG [StoreOpener-b637e0f476b878b3ffec2abf620c7df3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/cf 2023-07-21 20:12:00,093 DEBUG [StoreOpener-b637e0f476b878b3ffec2abf620c7df3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/cf 2023-07-21 20:12:00,093 INFO [StoreOpener-f256fb3d372f3120ca52ea1621fa197a-1] regionserver.HStore(310): Store=f256fb3d372f3120ca52ea1621fa197a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:12:00,093 INFO [StoreOpener-b637e0f476b878b3ffec2abf620c7df3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b637e0f476b878b3ffec2abf620c7df3 columnFamilyName cf 2023-07-21 20:12:00,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a 2023-07-21 20:12:00,094 INFO [StoreOpener-b637e0f476b878b3ffec2abf620c7df3-1] regionserver.HStore(310): Store=b637e0f476b878b3ffec2abf620c7df3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:12:00,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a 2023-07-21 20:12:00,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3 2023-07-21 20:12:00,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3 2023-07-21 20:12:00,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f256fb3d372f3120ca52ea1621fa197a 2023-07-21 20:12:00,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b637e0f476b878b3ffec2abf620c7df3 2023-07-21 20:12:00,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:12:00,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f256fb3d372f3120ca52ea1621fa197a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62565454, jitterRate=-0.06770208477973938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:12:00,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f256fb3d372f3120ca52ea1621fa197a: 2023-07-21 20:12:00,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:12:00,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b637e0f476b878b3ffec2abf620c7df3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75012165, jitterRate=0.11776836216449738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:12:00,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b637e0f476b878b3ffec2abf620c7df3: 2023-07-21 20:12:00,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3., pid=93, masterSystemTime=1689970320073 2023-07-21 20:12:00,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a., pid=94, masterSystemTime=1689970320073 2023-07-21 20:12:00,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:12:00,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:12:00,121 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b637e0f476b878b3ffec2abf620c7df3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,122 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970320121"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970320121"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970320121"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970320121"}]},"ts":"1689970320121"} 2023-07-21 20:12:00,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:12:00,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:12:00,123 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f256fb3d372f3120ca52ea1621fa197a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,124 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970320123"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970320123"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970320123"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970320123"}]},"ts":"1689970320123"} 2023-07-21 20:12:00,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-21 20:12:00,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure b637e0f476b878b3ffec2abf620c7df3, server=jenkins-hbase4.apache.org,45843,1689970216044 in 211 msec 2023-07-21 20:12:00,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-21 20:12:00,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure f256fb3d372f3120ca52ea1621fa197a, server=jenkins-hbase4.apache.org,39241,1689970215968 in 204 msec 2023-07-21 20:12:00,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b637e0f476b878b3ffec2abf620c7df3, ASSIGN in 374 msec 2023-07-21 20:12:00,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-21 20:12:00,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f256fb3d372f3120ca52ea1621fa197a, ASSIGN in 375 msec 2023-07-21 20:12:00,131 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:12:00,131 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970320131"}]},"ts":"1689970320131"} 2023-07-21 20:12:00,132 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-21 20:12:00,136 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:12:00,136 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-21 20:12:00,138 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 20:12:00,141 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:00,141 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:00,141 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:00,141 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:00,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:00,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:00,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:00,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:00,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 494 msec 2023-07-21 20:12:00,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 20:12:00,260 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-21 20:12:00,260 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-21 20:12:00,260 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:12:00,266 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-21 20:12:00,267 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:12:00,267 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-21 20:12:00,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:12:00,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970320269 (current time:1689970320269). 2023-07-21 20:12:00,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:12:00,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x479fa24a to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:00,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b01ba92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:00,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:00,286 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:00,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x479fa24a to 127.0.0.1:57298 2023-07-21 20:12:00,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:00,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x5c1f37a3 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:00,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66a85398, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:00,303 DEBUG [hconnection-0x20bbb0f5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:00,307 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36028, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:00,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:00,314 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:00,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c1f37a3 to 127.0.0.1:57298 2023-07-21 20:12:00,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:00,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 20:12:00,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:12:00,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:12:00,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:12:00,320 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:12:00,321 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689970920321 2023-07-21 20:12:00,321 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-21 20:12:00,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:12:00,323 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:12:00,323 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:12:00,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 20:12:00,324 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:12:00,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-21 20:12:00,328 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 20:12:00,329 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689970920329 2023-07-21 20:12:00,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,347 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-21 20:12:00,347 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:00,348 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-21 20:12:00,348 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-21 20:12:00,349 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,349 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,354 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:00,354 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:00,354 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:00,354 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:00,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:00,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:00,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:00,354 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:00,354 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:00,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,355 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,355 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:12:00,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 20:12:00,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 20:12:00,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 20:12:00,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,355 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 20:12:00,356 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 20:12:00,356 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 20:12:00,356 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,356 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,356 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 20:12:00,356 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:00,356 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 20:12:00,356 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:00,358 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,358 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 20:12:00,358 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 20:12:00,358 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 20:12:00,358 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 20:12:00,358 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 20:12:00,358 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 20:12:00,358 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:00,358 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 20:12:00,359 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 20:12:00,359 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 20:12:00,359 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 20:12:00,361 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,363 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,363 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,363 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,363 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,363 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:00,363 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:00,363 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,363 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:00,363 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,363 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:00,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 20:12:00,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bdbfe8a[Count = 1] remaining members to acquire global barrier 2023-07-21 20:12:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:00,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 20:12:00,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bdbfe8a[Count = 0] remaining members to acquire global barrier 2023-07-21 20:12:00,369 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 20:12:00,369 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,375 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,375 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,375 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,375 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:12:00,375 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,376 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:12:00,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,376 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:12:00,376 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 20:12:00,376 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38477,1689970216099' in zk 2023-07-21 20:12:00,376 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:00,376 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:00,376 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:12:00,376 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. started... 2023-07-21 20:12:00,378 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:00,378 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f256fb3d372f3120ca52ea1621fa197a: 2023-07-21 20:12:00,378 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:12:00,378 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. started... 2023-07-21 20:12:00,378 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,378 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:00,378 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:00,378 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:12:00,380 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,380 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:12:00,380 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b637e0f476b878b3ffec2abf620c7df3: 2023-07-21 20:12:00,380 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,380 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:00,380 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:12:00,381 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 20:12:00,381 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:00,381 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 20:12:00,399 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. completed. 2023-07-21 20:12:00,399 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:12:00,399 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:00,399 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:00,399 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,400 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 20:12:00,400 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39241,1689970215968' in zk 2023-07-21 20:12:00,402 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,402 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 20:12:00,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,402 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:00,402 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 20:12:00,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:00,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:00,404 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. completed. 2023-07-21 20:12:00,404 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:12:00,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:00,404 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:00,404 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:00,404 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,404 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 20:12:00,404 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45843,1689970216044' in zk 2023-07-21 20:12:00,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:00,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,406 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,407 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 20:12:00,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,407 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:00,407 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 20:12:00,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:00,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39241,1689970215968': 2023-07-21 20:12:00,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 20:12:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45843,1689970216044': 2023-07-21 20:12:00,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 20:12:00,415 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-21 20:12:00,415 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:12:00,415 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:12:00,415 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,415 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:12:00,417 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,417 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,417 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:00,417 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,417 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:00,417 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,418 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:00,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:00,417 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:00,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:00,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:00,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:00,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:00,418 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:00,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:00,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:00,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,419 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:00,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,420 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,421 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:00,421 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,423 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:00,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:12:00,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:00,424 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:12:00,424 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:00,424 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:00,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:00,425 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:00,425 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:00,425 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:00,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:00,426 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:00,425 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:00,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:00,426 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:00,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:00,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:00,425 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:00,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:00,425 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:00,426 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:00,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,427 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,427 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,427 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,427 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,427 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,427 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,427 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,427 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-21 20:12:00,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,467 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689970320321Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689970320427 (+106 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689970320427Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689970320430 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689970320438 (+8 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689970320466 (+28 ms) 2023-07-21 20:12:00,470 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 20:12:00,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 148 msec 2023-07-21 20:12:00,625 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:00,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:12:00,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:12:00,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:12:00,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45843] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:12:00,638 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-21 20:12:00,638 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:12:00,638 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:12:00,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:12:00,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970320652 (current time:1689970320652). 2023-07-21 20:12:00,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:12:00,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x16d18887 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:00,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b10aeb0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:00,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:00,668 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:00,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16d18887 to 127.0.0.1:57298 2023-07-21 20:12:00,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:00,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x7275f9b1 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:00,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@687ac2c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:00,677 DEBUG [hconnection-0x6718459-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:00,678 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:00,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:00,682 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:00,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7275f9b1 to 127.0.0.1:57298 2023-07-21 20:12:00,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:00,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 20:12:00,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:12:00,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:12:00,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:12:00,687 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:12:00,687 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689970920687 2023-07-21 20:12:00,687 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-21 20:12:00,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 20:12:00,689 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:12:00,689 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:12:00,689 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-21 20:12:00,690 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 20:12:00,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 20:12:00,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-21 20:12:00,694 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 20:12:00,694 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689970920694 2023-07-21 20:12:00,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,707 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-21 20:12:00,707 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:00,708 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-21 20:12:00,708 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-21 20:12:00,709 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,709 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,710 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:00,710 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:00,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:00,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:00,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:00,710 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,710 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:00,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:00,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:00,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:00,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,711 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,711 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,711 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,711 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:12:00,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 20:12:00,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,712 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 20:12:00,712 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,712 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 20:12:00,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 20:12:00,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 20:12:00,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,712 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:00,712 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 20:12:00,714 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 20:12:00,714 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 20:12:00,714 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 20:12:00,714 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 20:12:00,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,714 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 20:12:00,714 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:00,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,714 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 20:12:00,714 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:00,715 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 20:12:00,715 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 20:12:00,715 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 20:12:00,719 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 20:12:00,719 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 20:12:00,719 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 20:12:00,721 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:00,721 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:00,721 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,721 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,722 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:00,721 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:00,722 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,722 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:00,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:00,725 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,725 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,726 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:00,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 20:12:00,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dc68ec8[Count = 1] remaining members to acquire global barrier 2023-07-21 20:12:00,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:00,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:00,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:00,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:00,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:00,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 20:12:00,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dc68ec8[Count = 0] remaining members to acquire global barrier 2023-07-21 20:12:00,729 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 20:12:00,729 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,734 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,734 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,734 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,735 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:12:00,735 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:12:00,734 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 20:12:00,734 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,735 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 20:12:00,735 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38477,1689970216099' in zk 2023-07-21 20:12:00,735 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:00,735 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:00,735 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:12:00,735 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:00,735 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:12:00,735 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,735 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:12:00,735 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:00,735 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. started... 2023-07-21 20:12:00,735 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. started... 2023-07-21 20:12:00,735 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b637e0f476b878b3ffec2abf620c7df3 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-21 20:12:00,736 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f256fb3d372f3120ca52ea1621fa197a 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-21 20:12:00,736 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 20:12:00,737 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:00,737 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 20:12:00,764 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/.tmp/cf/de9645e54aee4232b43c07ee289269e0 2023-07-21 20:12:00,767 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/.tmp/cf/574ba05be7164a9eadecc17e3d0e01ac 2023-07-21 20:12:00,770 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/.tmp/cf/de9645e54aee4232b43c07ee289269e0 as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/cf/de9645e54aee4232b43c07ee289269e0 2023-07-21 20:12:00,784 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/.tmp/cf/574ba05be7164a9eadecc17e3d0e01ac as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/cf/574ba05be7164a9eadecc17e3d0e01ac 2023-07-21 20:12:00,787 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/cf/de9645e54aee4232b43c07ee289269e0, entries=3, sequenceid=6, filesize=5.0 K 2023-07-21 20:12:00,788 INFO [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for b637e0f476b878b3ffec2abf620c7df3 in 52ms, sequenceid=6, compaction requested=false 2023-07-21 20:12:00,789 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:00,789 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b637e0f476b878b3ffec2abf620c7df3: 2023-07-21 20:12:00,789 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,790 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:00,790 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/cf/de9645e54aee4232b43c07ee289269e0] hfiles 2023-07-21 20:12:00,790 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/cf/de9645e54aee4232b43c07ee289269e0 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:12:00,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:00,790 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:12:00,791 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/cf/574ba05be7164a9eadecc17e3d0e01ac, entries=47, sequenceid=6, filesize=8.0 K 2023-07-21 20:12:00,792 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for f256fb3d372f3120ca52ea1621fa197a in 57ms, sequenceid=6, compaction requested=false 2023-07-21 20:12:00,792 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f256fb3d372f3120ca52ea1621fa197a: 2023-07-21 20:12:00,792 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,792 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:00,792 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/cf/574ba05be7164a9eadecc17e3d0e01ac] hfiles 2023-07-21 20:12:00,792 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/cf/574ba05be7164a9eadecc17e3d0e01ac for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,804 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. completed. 2023-07-21 20:12:00,804 DEBUG [rs(jenkins-hbase4.apache.org,45843,1689970216044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:12:00,804 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:00,804 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:00,804 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,804 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 20:12:00,804 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45843,1689970216044' in zk 2023-07-21 20:12:00,806 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 20:12:00,806 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,806 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:00,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:00,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:00,806 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 20:12:00,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:00,810 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. completed. 2023-07-21 20:12:00,811 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:12:00,811 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:00,811 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:00,811 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,811 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 20:12:00,811 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39241,1689970215968' in zk 2023-07-21 20:12:00,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:00,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,813 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 20:12:00,813 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,813 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:00,813 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 20:12:00,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:00,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45843,1689970216044': 2023-07-21 20:12:00,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 20:12:00,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:00,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:00,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:00,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:00,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:00,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39241,1689970215968': 2023-07-21 20:12:00,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 20:12:00,827 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-21 20:12:00,827 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:12:00,827 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:12:00,827 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,827 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:12:00,830 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,830 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,830 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,830 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:00,830 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,830 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:00,830 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:00,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:00,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:00,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:00,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:00,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:00,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:00,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:00,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:00,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:00,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,834 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,835 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:00,835 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:00,837 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,837 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,838 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,841 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:00,841 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:00,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:00,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:00,841 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:00,841 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,841 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:00,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:00,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:00,841 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:00,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:00,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:00,841 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:00,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:00,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:00,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:00,841 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:00,843 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:00,843 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,844 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,844 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,844 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,844 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:00,844 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,844 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:00,844 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:00,844 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,844 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:00,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,942 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-21 20:12:00,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,943 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:00,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689970320687Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689970320841 (+154 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689970320841Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689970320857 (+16 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689970320899 (+42 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689970320942 (+43 ms) 2023-07-21 20:12:00,950 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 20:12:00,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 261 msec 2023-07-21 20:12:00,991 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:00,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 20:12:00,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:12:00,992 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970320992 2023-07-21 20:12:00,992 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33875, tgtDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970320992, rawTgtDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970320992, srcFsUri=hdfs://localhost:33875, srcDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:12:01,025 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:12:01,025 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1219475886_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970320992, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970320992/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:01,025 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091, snapshotDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-21 20:12:01,037 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970320992/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:01,087 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:01,087 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:01,088 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:01,088 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:02,136 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-5902346349053800961.jar 2023-07-21 20:12:02,137 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:02,137 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:02,210 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-7483302088523031580.jar 2023-07-21 20:12:02,210 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:02,211 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:02,211 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:02,212 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:02,212 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:02,212 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:02,213 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:12:02,213 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:12:02,213 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:12:02,214 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:12:02,214 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:12:02,215 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:12:02,215 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:12:02,216 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:12:02,216 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:12:02,216 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:12:02,217 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:02,217 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:02,218 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:12:02,218 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:02,219 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:02,219 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:12:02,220 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:12:02,957 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0005_000001 (auth:SIMPLE) 2023-07-21 20:12:03,214 WARN [Listener at jenkins-hbase4.apache.org/33191] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:12:03,217 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-21 20:12:03,330 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:12:03,330 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:12:03,689 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0006_000001 (auth:SIMPLE) 2023-07-21 20:12:04,520 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:12:10,144 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0006_000001 (auth:SIMPLE) 2023-07-21 20:12:12,696 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:12:12,697 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:12:12,707 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:12,707 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:12:12,708 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:12:12,708 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1181763459_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:12,709 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-21 20:12:12,709 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-21 20:12:12,709 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1181763459_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970320992/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970320992/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:12,710 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970320992/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-21 20:12:12,710 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970320992/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-21 20:12:12,716 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-21 20:12:12,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-21 20:12:12,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:12,723 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970332723"}]},"ts":"1689970332723"} 2023-07-21 20:12:12,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 20:12:12,725 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-21 20:12:12,727 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-21 20:12:12,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b637e0f476b878b3ffec2abf620c7df3, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f256fb3d372f3120ca52ea1621fa197a, UNASSIGN}] 2023-07-21 20:12:12,730 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b637e0f476b878b3ffec2abf620c7df3, UNASSIGN 2023-07-21 20:12:12,730 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f256fb3d372f3120ca52ea1621fa197a, UNASSIGN 2023-07-21 20:12:12,731 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b637e0f476b878b3ffec2abf620c7df3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:12,731 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f256fb3d372f3120ca52ea1621fa197a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:12,731 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970332731"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970332731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970332731"}]},"ts":"1689970332731"} 2023-07-21 20:12:12,731 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970332731"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970332731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970332731"}]},"ts":"1689970332731"} 2023-07-21 20:12:12,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure b637e0f476b878b3ffec2abf620c7df3, server=jenkins-hbase4.apache.org,45843,1689970216044}] 2023-07-21 20:12:12,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure f256fb3d372f3120ca52ea1621fa197a, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:12:12,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 20:12:12,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b637e0f476b878b3ffec2abf620c7df3 2023-07-21 20:12:12,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b637e0f476b878b3ffec2abf620c7df3, disabling compactions & flushes 2023-07-21 20:12:12,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:12:12,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:12:12,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. after waiting 0 ms 2023-07-21 20:12:12,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:12:12,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f256fb3d372f3120ca52ea1621fa197a 2023-07-21 20:12:12,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f256fb3d372f3120ca52ea1621fa197a, disabling compactions & flushes 2023-07-21 20:12:12,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:12:12,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:12:12,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. after waiting 0 ms 2023-07-21 20:12:12,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:12:12,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:12:12,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:12:12,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:12:12,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3. 2023-07-21 20:12:12,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b637e0f476b878b3ffec2abf620c7df3: 2023-07-21 20:12:12,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:12:12,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a. 2023-07-21 20:12:12,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f256fb3d372f3120ca52ea1621fa197a: 2023-07-21 20:12:12,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b637e0f476b878b3ffec2abf620c7df3 2023-07-21 20:12:12,915 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b637e0f476b878b3ffec2abf620c7df3, regionState=CLOSED 2023-07-21 20:12:12,915 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970332915"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970332915"}]},"ts":"1689970332915"} 2023-07-21 20:12:12,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f256fb3d372f3120ca52ea1621fa197a 2023-07-21 20:12:12,920 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f256fb3d372f3120ca52ea1621fa197a, regionState=CLOSED 2023-07-21 20:12:12,920 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689970332920"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970332920"}]},"ts":"1689970332920"} 2023-07-21 20:12:12,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-21 20:12:12,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure b637e0f476b878b3ffec2abf620c7df3, server=jenkins-hbase4.apache.org,45843,1689970216044 in 184 msec 2023-07-21 20:12:12,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b637e0f476b878b3ffec2abf620c7df3, UNASSIGN in 201 msec 2023-07-21 20:12:12,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-21 20:12:12,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure f256fb3d372f3120ca52ea1621fa197a, server=jenkins-hbase4.apache.org,39241,1689970215968 in 194 msec 2023-07-21 20:12:12,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-21 20:12:12,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f256fb3d372f3120ca52ea1621fa197a, UNASSIGN in 203 msec 2023-07-21 20:12:12,933 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970332933"}]},"ts":"1689970332933"} 2023-07-21 20:12:12,935 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-21 20:12:12,936 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-21 20:12:12,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 220 msec 2023-07-21 20:12:13,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 20:12:13,027 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-21 20:12:13,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,035 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,036 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,037 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,041 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a 2023-07-21 20:12:13,041 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3 2023-07-21 20:12:13,042 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,042 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,042 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,042 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 20:12:13,044 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/recovered.edits] 2023-07-21 20:12:13,044 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:13,044 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,044 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:13,044 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-21 20:12:13,044 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:12:13,044 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:13,044 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-21 20:12:13,044 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:13,044 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-21 20:12:13,044 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:12:13,044 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:12:13,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-21 20:12:13,064 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/cf/574ba05be7164a9eadecc17e3d0e01ac to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/cf/574ba05be7164a9eadecc17e3d0e01ac 2023-07-21 20:12:13,068 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/recovered.edits/9.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a/recovered.edits/9.seqid 2023-07-21 20:12:13,069 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/f256fb3d372f3120ca52ea1621fa197a 2023-07-21 20:12:13,079 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/recovered.edits] 2023-07-21 20:12:13,085 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/cf/de9645e54aee4232b43c07ee289269e0 to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/cf/de9645e54aee4232b43c07ee289269e0 2023-07-21 20:12:13,088 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/recovered.edits/9.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3/recovered.edits/9.seqid 2023-07-21 20:12:13,089 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testEmptyExportFileSystemState/b637e0f476b878b3ffec2abf620c7df3 2023-07-21 20:12:13,089 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-21 20:12:13,092 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,097 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-21 20:12:13,105 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-21 20:12:13,106 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,106 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-21 20:12:13,107 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970333106"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:13,107 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970333106"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:13,109 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 20:12:13,109 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b637e0f476b878b3ffec2abf620c7df3, NAME => 'testtb-testEmptyExportFileSystemState,,1689970319649.b637e0f476b878b3ffec2abf620c7df3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f256fb3d372f3120ca52ea1621fa197a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689970319649.f256fb3d372f3120ca52ea1621fa197a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 20:12:13,109 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-21 20:12:13,109 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970333109"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:13,111 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-21 20:12:13,113 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 20:12:13,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 85 msec 2023-07-21 20:12:13,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-21 20:12:13,150 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-21 20:12:13,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-21 20:12:13,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:13,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-21 20:12:13,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34903] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-21 20:12:13,197 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 760) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:33191 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:39236 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:36540 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:46803 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4602 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:33217 from appattempt_1689970225344_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:59158 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1786699616_1 at /127.0.0.1:39208 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1786699616_1 at /127.0.0.1:59138 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=476 (was 405) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 190), AvailableMemoryMB=6028 (was 6251) 2023-07-21 20:12:13,197 WARN [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-21 20:12:13,228 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=476, ProcessCount=187, AvailableMemoryMB=6020 2023-07-21 20:12:13,228 WARN [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-21 20:12:13,231 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 20:12:13,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:13,235 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 20:12:13,236 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-21 20:12:13,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 20:12:13,240 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 20:12:13,250 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48 2023-07-21 20:12:13,250 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27 2023-07-21 20:12:13,251 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48 empty. 2023-07-21 20:12:13,251 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27 empty. 2023-07-21 20:12:13,252 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48 2023-07-21 20:12:13,252 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27 2023-07-21 20:12:13,252 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-21 20:12:13,331 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-21 20:12:13,335 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 121f209c187b30cfe80cfd9968fbab27, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:12:13,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 20:12:13,339 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1f9de1dc28e9eee4322e5252c9c93f48, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp 2023-07-21 20:12:13,419 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:13,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 121f209c187b30cfe80cfd9968fbab27, disabling compactions & flushes 2023-07-21 20:12:13,420 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:13,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:13,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. after waiting 0 ms 2023-07-21 20:12:13,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:13,420 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:13,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 121f209c187b30cfe80cfd9968fbab27: 2023-07-21 20:12:13,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 20:12:13,821 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:13,821 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 1f9de1dc28e9eee4322e5252c9c93f48, disabling compactions & flushes 2023-07-21 20:12:13,821 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:13,821 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:13,821 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. after waiting 0 ms 2023-07-21 20:12:13,821 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:13,821 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:13,821 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 1f9de1dc28e9eee4322e5252c9c93f48: 2023-07-21 20:12:13,826 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 20:12:13,828 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970333827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970333827"}]},"ts":"1689970333827"} 2023-07-21 20:12:13,828 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970333827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970333827"}]},"ts":"1689970333827"} 2023-07-21 20:12:13,830 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 20:12:13,831 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 20:12:13,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970333831"}]},"ts":"1689970333831"} 2023-07-21 20:12:13,832 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-21 20:12:13,835 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 20:12:13,837 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 20:12:13,837 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 20:12:13,837 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 20:12:13,837 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 20:12:13,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=121f209c187b30cfe80cfd9968fbab27, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1f9de1dc28e9eee4322e5252c9c93f48, ASSIGN}] 2023-07-21 20:12:13,841 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1f9de1dc28e9eee4322e5252c9c93f48, ASSIGN 2023-07-21 20:12:13,841 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=121f209c187b30cfe80cfd9968fbab27, ASSIGN 2023-07-21 20:12:13,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 20:12:13,845 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1f9de1dc28e9eee4322e5252c9c93f48, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39241,1689970215968; forceNewPlan=false, retain=false 2023-07-21 20:12:13,845 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=121f209c187b30cfe80cfd9968fbab27, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38477,1689970216099; forceNewPlan=false, retain=false 2023-07-21 20:12:13,995 INFO [jenkins-hbase4:34903] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 20:12:13,998 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1f9de1dc28e9eee4322e5252c9c93f48, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:13,998 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=121f209c187b30cfe80cfd9968fbab27, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:13,998 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970333998"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970333998"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970333998"}]},"ts":"1689970333998"} 2023-07-21 20:12:13,998 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970333998"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970333998"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970333998"}]},"ts":"1689970333998"} 2023-07-21 20:12:14,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 1f9de1dc28e9eee4322e5252c9c93f48, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:12:14,005 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 121f209c187b30cfe80cfd9968fbab27, server=jenkins-hbase4.apache.org,38477,1689970216099}] 2023-07-21 20:12:14,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:14,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1f9de1dc28e9eee4322e5252c9c93f48, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 20:12:14,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. service=AccessControlService 2023-07-21 20:12:14,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:12:14,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 1f9de1dc28e9eee4322e5252c9c93f48 2023-07-21 20:12:14,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:14,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1f9de1dc28e9eee4322e5252c9c93f48 2023-07-21 20:12:14,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1f9de1dc28e9eee4322e5252c9c93f48 2023-07-21 20:12:14,181 INFO [StoreOpener-1f9de1dc28e9eee4322e5252c9c93f48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1f9de1dc28e9eee4322e5252c9c93f48 2023-07-21 20:12:14,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:14,186 DEBUG [StoreOpener-1f9de1dc28e9eee4322e5252c9c93f48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/cf 2023-07-21 20:12:14,186 DEBUG [StoreOpener-1f9de1dc28e9eee4322e5252c9c93f48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/cf 2023-07-21 20:12:14,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 121f209c187b30cfe80cfd9968fbab27, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 20:12:14,187 INFO [StoreOpener-1f9de1dc28e9eee4322e5252c9c93f48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f9de1dc28e9eee4322e5252c9c93f48 columnFamilyName cf 2023-07-21 20:12:14,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. service=AccessControlService 2023-07-21 20:12:14,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 20:12:14,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 121f209c187b30cfe80cfd9968fbab27 2023-07-21 20:12:14,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 20:12:14,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 121f209c187b30cfe80cfd9968fbab27 2023-07-21 20:12:14,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 121f209c187b30cfe80cfd9968fbab27 2023-07-21 20:12:14,191 INFO [StoreOpener-1f9de1dc28e9eee4322e5252c9c93f48-1] regionserver.HStore(310): Store=1f9de1dc28e9eee4322e5252c9c93f48/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:12:14,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48 2023-07-21 20:12:14,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48 2023-07-21 20:12:14,195 INFO [StoreOpener-121f209c187b30cfe80cfd9968fbab27-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 121f209c187b30cfe80cfd9968fbab27 2023-07-21 20:12:14,198 DEBUG [StoreOpener-121f209c187b30cfe80cfd9968fbab27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/cf 2023-07-21 20:12:14,198 DEBUG [StoreOpener-121f209c187b30cfe80cfd9968fbab27-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/cf 2023-07-21 20:12:14,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1f9de1dc28e9eee4322e5252c9c93f48 2023-07-21 20:12:14,199 INFO [StoreOpener-121f209c187b30cfe80cfd9968fbab27-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 121f209c187b30cfe80cfd9968fbab27 columnFamilyName cf 2023-07-21 20:12:14,200 INFO [StoreOpener-121f209c187b30cfe80cfd9968fbab27-1] regionserver.HStore(310): Store=121f209c187b30cfe80cfd9968fbab27/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 20:12:14,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27 2023-07-21 20:12:14,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:12:14,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1f9de1dc28e9eee4322e5252c9c93f48; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65862654, jitterRate=-0.018569976091384888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:12:14,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27 2023-07-21 20:12:14,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1f9de1dc28e9eee4322e5252c9c93f48: 2023-07-21 20:12:14,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48., pid=108, masterSystemTime=1689970334157 2023-07-21 20:12:14,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:14,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:14,224 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1f9de1dc28e9eee4322e5252c9c93f48, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:14,225 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970334224"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970334224"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970334224"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970334224"}]},"ts":"1689970334224"} 2023-07-21 20:12:14,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 121f209c187b30cfe80cfd9968fbab27 2023-07-21 20:12:14,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-21 20:12:14,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 1f9de1dc28e9eee4322e5252c9c93f48, server=jenkins-hbase4.apache.org,39241,1689970215968 in 223 msec 2023-07-21 20:12:14,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1f9de1dc28e9eee4322e5252c9c93f48, ASSIGN in 393 msec 2023-07-21 20:12:14,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 20:12:14,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 121f209c187b30cfe80cfd9968fbab27; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66988162, jitterRate=-0.0017985999584197998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 20:12:14,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 121f209c187b30cfe80cfd9968fbab27: 2023-07-21 20:12:14,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27., pid=109, masterSystemTime=1689970334157 2023-07-21 20:12:14,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:14,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:14,259 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=121f209c187b30cfe80cfd9968fbab27, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:14,259 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970334258"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689970334258"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689970334258"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689970334258"}]},"ts":"1689970334258"} 2023-07-21 20:12:14,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-21 20:12:14,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 121f209c187b30cfe80cfd9968fbab27, server=jenkins-hbase4.apache.org,38477,1689970216099 in 256 msec 2023-07-21 20:12:14,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-21 20:12:14,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=121f209c187b30cfe80cfd9968fbab27, ASSIGN in 430 msec 2023-07-21 20:12:14,272 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 20:12:14,273 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970334273"}]},"ts":"1689970334273"} 2023-07-21 20:12:14,275 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-21 20:12:14,277 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 20:12:14,278 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-21 20:12:14,280 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 20:12:14,282 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:14,282 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:14,283 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:14,283 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:14,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:14,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:14,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:14,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 20:12:14,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 1.0530 sec 2023-07-21 20:12:14,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 20:12:14,344 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-21 20:12:14,345 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-21 20:12:14,345 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:12:14,362 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-21 20:12:14,362 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:12:14,362 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-21 20:12:14,365 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 20:12:14,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970334366 (current time:1689970334366). 2023-07-21 20:12:14,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:12:14,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x146e567d to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:14,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a4e133d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:14,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:14,430 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:14,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x146e567d to 127.0.0.1:57298 2023-07-21 20:12:14,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:14,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x127ad8be to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:14,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7441a932, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:14,543 DEBUG [hconnection-0x6e8c8b7c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:14,548 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44028, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:14,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:14,558 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:14,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x127ad8be to 127.0.0.1:57298 2023-07-21 20:12:14,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:14,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 20:12:14,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:12:14,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 20:12:14,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 20:12:14,565 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 20:12:14,566 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689970934566 2023-07-21 20:12:14,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 20:12:14,566 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,568 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:12:14,569 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:12:14,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 20:12:14,572 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 20:12:14,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 10 msec 2023-07-21 20:12:14,574 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 20:12:14,575 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689970934575 2023-07-21 20:12:14,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,609 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-21 20:12:14,609 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:14,610 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-21 20:12:14,610 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-21 20:12:14,611 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,611 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,618 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:14,618 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:14,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:14,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:14,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:14,618 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:14,618 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:14,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:14,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:14,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:14,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,619 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:14,619 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:14,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,619 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:14,619 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:12:14,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 20:12:14,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 20:12:14,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 20:12:14,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,620 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 20:12:14,620 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 20:12:14,620 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 20:12:14,620 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,620 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,620 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 20:12:14,620 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 20:12:14,620 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:14,620 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:14,622 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,622 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 20:12:14,622 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 20:12:14,622 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:14,622 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 20:12:14,622 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 20:12:14,628 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 20:12:14,628 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 20:12:14,628 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 20:12:14,628 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 20:12:14,628 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,628 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 20:12:14,628 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 20:12:14,628 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,628 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:14,630 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:14,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:14,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:14,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:14,630 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,631 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,631 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:14,631 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,631 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,632 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:14,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:14,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:14,632 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:14,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:14,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:14,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:14,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:14,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 20:12:14,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40957bf7[Count = 1] remaining members to acquire global barrier 2023-07-21 20:12:14,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:14,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:14,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:14,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:14,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:14,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:14,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:14,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:14,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:14,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 20:12:14,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40957bf7[Count = 0] remaining members to acquire global barrier 2023-07-21 20:12:14,637 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-21 20:12:14,637 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,638 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,638 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,638 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,638 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 20:12:14,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,638 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:14,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,639 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 20:12:14,639 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 20:12:14,639 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 20:12:14,639 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45843,1689970216044' in zk 2023-07-21 20:12:14,640 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:14,640 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:14,640 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:14,640 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:14,640 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:14,640 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. started... 2023-07-21 20:12:14,640 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. started... 2023-07-21 20:12:14,640 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:14,642 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1f9de1dc28e9eee4322e5252c9c93f48: 2023-07-21 20:12:14,642 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 121f209c187b30cfe80cfd9968fbab27: 2023-07-21 20:12:14,643 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,643 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:14,643 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:14,643 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:14,643 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:12:14,643 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 20:12:14,644 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:14,644 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:12:14,645 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 20:12:14,645 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:14,645 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 20:12:14,669 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:14,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:14,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:14,670 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:12:14,870 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:14,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:14,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:14,873 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:12:15,086 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. completed. 2023-07-21 20:12:15,086 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:15,086 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. completed. 2023-07-21 20:12:15,087 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:15,086 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:15,087 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:15,087 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:15,087 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:15,087 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,087 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,087 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 20:12:15,087 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 20:12:15,087 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38477,1689970216099' in zk 2023-07-21 20:12:15,087 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39241,1689970215968' in zk 2023-07-21 20:12:15,089 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,089 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 20:12:15,089 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,089 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 20:12:15,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:15,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:15,089 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:15,089 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:15,090 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 20:12:15,091 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 20:12:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:15,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:15,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38477,1689970216099': 2023-07-21 20:12:15,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-21 20:12:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:15,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:15,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:15,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39241,1689970215968': 2023-07-21 20:12:15,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-21 20:12:15,102 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-21 20:12:15,102 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:12:15,102 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:12:15,102 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,103 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:12:15,105 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,106 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:15,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,106 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,106 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,106 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:15,106 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,106 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:15,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:15,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:15,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:15,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:15,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:15,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:15,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:15,107 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:15,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,108 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:15,109 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:15,111 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,111 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,112 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,115 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:15,115 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:15,115 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:15,115 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:15,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:15,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:15,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:15,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:15,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:15,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:15,116 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:15,116 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:15,116 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,116 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:15,116 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,116 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:15,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:15,116 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,116 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,117 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,117 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,117 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,117 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,117 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,117 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,117 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:15,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:15,173 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:15,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:15,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:15,175 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 20:12:15,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,244 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-21 20:12:15,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,245 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689970334566Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689970335117 (+551 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689970335117Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689970335133 (+16 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689970335167 (+34 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689970335244 (+77 ms) 2023-07-21 20:12:15,248 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 20:12:15,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 680 msec 2023-07-21 20:12:15,675 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:15,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:15,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:12:15,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38477] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:12:15,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 20:12:15,695 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,696 DEBUG [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:15,696 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 20:12:15,707 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 20:12:15,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689970335707 (current time:1689970335707). 2023-07-21 20:12:15,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 20:12:15,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x700fb1c2 to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:15,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ad213d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:15,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:15,722 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:15,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x700fb1c2 to 127.0.0.1:57298 2023-07-21 20:12:15,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:15,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] zookeeper.ReadOnlyZKClient(139): Connect 0x62c03bff to 127.0.0.1:57298 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 20:12:15,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fcc17c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 20:12:15,735 DEBUG [hconnection-0x5eaf55a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:15,738 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:15,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 20:12:15,746 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 20:12:15,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62c03bff to 127.0.0.1:57298 2023-07-21 20:12:15,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:12:15,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 20:12:15,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 20:12:15,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 20:12:15,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 20:12:15,752 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 20:12:15,753 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689970935753 2023-07-21 20:12:15,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 20:12:15,753 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,759 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 20:12:15,759 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 20:12:15,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 20:12:15,762 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 20:12:15,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 12 msec 2023-07-21 20:12:15,764 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 20:12:15,765 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689970935765 2023-07-21 20:12:15,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,783 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-21 20:12:15,783 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:15,785 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-21 20:12:15,786 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-21 20:12:15,852 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,852 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,853 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:15,853 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:15,853 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:15,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:15,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:15,853 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:15,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,854 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,854 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,855 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,855 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 20:12:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 20:12:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 20:12:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 20:12:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,855 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 20:12:15,855 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 20:12:15,855 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 20:12:15,856 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,856 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 20:12:15,856 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,856 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:15,856 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 20:12:15,856 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:15,857 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,858 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 20:12:15,858 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 20:12:15,858 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 20:12:15,857 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 20:12:15,859 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 20:12:15,859 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 20:12:15,859 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:15,858 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 20:12:15,860 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 20:12:15,859 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45843,1689970216044' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 20:12:15,859 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 20:12:15,860 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 20:12:15,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:15,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:15,861 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 20:12:15,861 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,861 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:15,863 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,863 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:15,863 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:15,864 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,864 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,865 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:15,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:15,865 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,865 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,865 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 20:12:15,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:15,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39241,1689970215968' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 20:12:15,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1948c6fc[Count = 1] remaining members to acquire global barrier 2023-07-21 20:12:15,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:15,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:15,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:15,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:15,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:15,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38477,1689970216099' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 20:12:15,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1948c6fc[Count = 0] remaining members to acquire global barrier 2023-07-21 20:12:15,869 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-21 20:12:15,869 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,874 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,874 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,874 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 20:12:15,874 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 20:12:15,874 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 20:12:15,874 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45843,1689970216044' in zk 2023-07-21 20:12:15,875 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:15,875 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:15,875 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:15,875 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,875 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. started... 2023-07-21 20:12:15,875 INFO [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 121f209c187b30cfe80cfd9968fbab27 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-21 20:12:15,876 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 20:12:15,876 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,876 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 20:12:15,876 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,876 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:15,876 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 20:12:15,876 DEBUG [member: 'jenkins-hbase4.apache.org,45843,1689970216044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 20:12:15,879 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 20:12:15,879 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 20:12:15,879 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:15,879 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. started... 2023-07-21 20:12:15,879 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1f9de1dc28e9eee4322e5252c9c93f48 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-21 20:12:15,890 INFO [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/.tmp/cf/aa2e5dd853aa4f8da2e54f3d3e847595 2023-07-21 20:12:15,892 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/.tmp/cf/51fd565d99f04817be92ccdd779d7775 2023-07-21 20:12:15,896 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/.tmp/cf/aa2e5dd853aa4f8da2e54f3d3e847595 as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/cf/aa2e5dd853aa4f8da2e54f3d3e847595 2023-07-21 20:12:15,898 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/.tmp/cf/51fd565d99f04817be92ccdd779d7775 as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/cf/51fd565d99f04817be92ccdd779d7775 2023-07-21 20:12:15,901 INFO [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/cf/aa2e5dd853aa4f8da2e54f3d3e847595, entries=4, sequenceid=6, filesize=5.1 K 2023-07-21 20:12:15,904 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/cf/51fd565d99f04817be92ccdd779d7775, entries=46, sequenceid=6, filesize=7.9 K 2023-07-21 20:12:15,911 INFO [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 121f209c187b30cfe80cfd9968fbab27 in 36ms, sequenceid=6, compaction requested=false 2023-07-21 20:12:15,911 INFO [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 1f9de1dc28e9eee4322e5252c9c93f48 in 32ms, sequenceid=6, compaction requested=false 2023-07-21 20:12:15,911 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-21 20:12:15,911 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-21 20:12:15,913 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 121f209c187b30cfe80cfd9968fbab27: 2023-07-21 20:12:15,913 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,914 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:15,914 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/cf/aa2e5dd853aa4f8da2e54f3d3e847595] hfiles 2023-07-21 20:12:15,914 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/cf/aa2e5dd853aa4f8da2e54f3d3e847595 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,923 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1f9de1dc28e9eee4322e5252c9c93f48: 2023-07-21 20:12:15,923 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,923 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 20:12:15,923 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/cf/51fd565d99f04817be92ccdd779d7775] hfiles 2023-07-21 20:12:15,923 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/cf/51fd565d99f04817be92ccdd779d7775 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,939 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. completed. 2023-07-21 20:12:15,939 DEBUG [rs(jenkins-hbase4.apache.org,38477,1689970216099)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:15,939 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:15,939 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:15,939 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,962 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 20:12:15,963 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38477,1689970216099' in zk 2023-07-21 20:12:15,965 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 20:12:15,965 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,965 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:15,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:15,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:15,965 DEBUG [member: 'jenkins-hbase4.apache.org,38477,1689970216099' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 20:12:15,968 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. completed. 2023-07-21 20:12:15,968 DEBUG [rs(jenkins-hbase4.apache.org,39241,1689970215968)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:15,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:15,968 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 20:12:15,968 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 20:12:15,968 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,969 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 20:12:15,969 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39241,1689970215968' in zk 2023-07-21 20:12:15,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:15,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,974 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,974 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 20:12:15,974 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:15,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:15,974 DEBUG [member: 'jenkins-hbase4.apache.org,39241,1689970215968' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 20:12:15,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38477,1689970216099': 2023-07-21 20:12:15,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38477,1689970216099' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-21 20:12:15,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:15,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:15,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:15,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:15,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:15,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39241,1689970215968': 2023-07-21 20:12:15,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39241,1689970215968' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-21 20:12:15,980 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-21 20:12:15,980 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 20:12:15,980 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 20:12:15,980 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,980 INFO [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 20:12:15,983 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,983 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,983 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:15,984 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,984 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:15,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,984 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 20:12:15,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 20:12:15,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,983 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:15,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:15,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 20:12:15,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:15,984 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:15,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,986 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 20:12:15,986 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 20:12:15,988 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,989 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,990 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,993 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,993 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:15,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:15,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:15,993 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:15,993 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:15,993 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:15,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:15,993 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,993 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,993 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,993 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,994 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:12:15,994 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:15,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,994 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,994 DEBUG [(jenkins-hbase4.apache.org,34903,1689970214352)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 20:12:15,994 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:15,996 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 20:12:15,996 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:15,996 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 20:12:15,996 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 20:12:15,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 20:12:15,996 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:15,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:15,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:15,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:15,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:15,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 20:12:15,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 20:12:16,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:16,061 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:16,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:16,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 20:12:16,062 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 20:12:16,080 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-21 20:12:16,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:16,080 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:16,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689970335753Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689970335994 (+241 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689970335994Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689970336015 (+21 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689970336026 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689970336080 (+54 ms) 2023-07-21 20:12:16,084 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 20:12:16,086 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 329 msec 2023-07-21 20:12:16,362 DEBUG [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 20:12:16,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 20:12:16,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 20:12:16,364 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970336364 2023-07-21 20:12:16,365 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33875, tgtDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970336364, rawTgtDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970336364, srcFsUri=hdfs://localhost:33875, srcDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:12:16,394 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091 2023-07-21 20:12:16,394 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1373856800_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970336364, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970336364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:16,394 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33875, inputRoot=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091, snapshotDir=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-21 20:12:16,407 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970336364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:16,446 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:16,446 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:16,447 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:16,447 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:17,432 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-8727745441711392342.jar 2023-07-21 20:12:17,433 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:17,433 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:17,520 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/hadoop-6102629043965838513.jar 2023-07-21 20:12:17,520 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:17,521 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:17,521 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:17,522 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:17,522 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:17,522 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 20:12:17,523 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 20:12:17,523 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 20:12:17,524 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 20:12:17,524 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 20:12:17,525 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 20:12:17,525 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 20:12:17,526 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 20:12:17,526 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 20:12:17,527 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 20:12:17,527 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 20:12:17,528 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:17,528 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:17,528 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:12:17,529 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:17,529 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 20:12:17,529 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:12:17,530 DEBUG [Listener at jenkins-hbase4.apache.org/33191] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 20:12:17,541 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0006_000001 (auth:SIMPLE) 2023-07-21 20:12:18,577 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:12:18,807 WARN [Listener at jenkins-hbase4.apache.org/33191] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 20:12:18,810 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-21 20:12:18,815 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 20:12:18,905 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:12:18,905 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 20:12:18,972 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0007_000001 (auth:SIMPLE) 2023-07-21 20:12:24,577 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0007_000001 (auth:SIMPLE) 2023-07-21 20:12:26,886 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0007_000001 (auth:SIMPLE) 2023-07-21 20:12:31,407 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0007_000001 (auth:SIMPLE) 2023-07-21 20:12:33,055 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 20:12:33,055 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 20:12:33,073 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,073 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 20:12:33,074 INFO [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 20:12:33,074 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1181763459_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,079 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-21 20:12:33,079 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-21 20:12:33,079 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1181763459_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970336364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970336364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,081 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970336364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-21 20:12:33,081 DEBUG [Listener at jenkins-hbase4.apache.org/33191] snapshot.TestExportSnapshot(367): hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/export-test/export-1689970336364/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-21 20:12:33,106 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,106 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 20:12:33,114 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970353114"}]},"ts":"1689970353114"} 2023-07-21 20:12:33,133 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-21 20:12:33,135 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-21 20:12:33,136 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=121f209c187b30cfe80cfd9968fbab27, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1f9de1dc28e9eee4322e5252c9c93f48, UNASSIGN}] 2023-07-21 20:12:33,137 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1f9de1dc28e9eee4322e5252c9c93f48, UNASSIGN 2023-07-21 20:12:33,140 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=121f209c187b30cfe80cfd9968fbab27, UNASSIGN 2023-07-21 20:12:33,141 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=1f9de1dc28e9eee4322e5252c9c93f48, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:12:33,141 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=121f209c187b30cfe80cfd9968fbab27, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:12:33,141 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970353141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970353141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970353141"}]},"ts":"1689970353141"} 2023-07-21 20:12:33,141 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970353141"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689970353141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689970353141"}]},"ts":"1689970353141"} 2023-07-21 20:12:33,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 121f209c187b30cfe80cfd9968fbab27, server=jenkins-hbase4.apache.org,38477,1689970216099}] 2023-07-21 20:12:33,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 1f9de1dc28e9eee4322e5252c9c93f48, server=jenkins-hbase4.apache.org,39241,1689970215968}] 2023-07-21 20:12:33,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 20:12:33,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 121f209c187b30cfe80cfd9968fbab27 2023-07-21 20:12:33,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 121f209c187b30cfe80cfd9968fbab27, disabling compactions & flushes 2023-07-21 20:12:33,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:33,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:33,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. after waiting 0 ms 2023-07-21 20:12:33,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:33,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1f9de1dc28e9eee4322e5252c9c93f48 2023-07-21 20:12:33,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1f9de1dc28e9eee4322e5252c9c93f48, disabling compactions & flushes 2023-07-21 20:12:33,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:33,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:33,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. after waiting 0 ms 2023-07-21 20:12:33,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:33,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:12:33,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:12:33,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:12:33,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48. 2023-07-21 20:12:33,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:12:33,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1f9de1dc28e9eee4322e5252c9c93f48: 2023-07-21 20:12:33,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27. 2023-07-21 20:12:33,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 121f209c187b30cfe80cfd9968fbab27: 2023-07-21 20:12:33,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1f9de1dc28e9eee4322e5252c9c93f48 2023-07-21 20:12:33,396 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=1f9de1dc28e9eee4322e5252c9c93f48, regionState=CLOSED 2023-07-21 20:12:33,396 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970353396"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970353396"}]},"ts":"1689970353396"} 2023-07-21 20:12:33,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 121f209c187b30cfe80cfd9968fbab27 2023-07-21 20:12:33,397 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=121f209c187b30cfe80cfd9968fbab27, regionState=CLOSED 2023-07-21 20:12:33,397 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689970353397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689970353397"}]},"ts":"1689970353397"} 2023-07-21 20:12:33,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-21 20:12:33,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 1f9de1dc28e9eee4322e5252c9c93f48, server=jenkins-hbase4.apache.org,39241,1689970215968 in 252 msec 2023-07-21 20:12:33,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-21 20:12:33,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 121f209c187b30cfe80cfd9968fbab27, server=jenkins-hbase4.apache.org,38477,1689970216099 in 253 msec 2023-07-21 20:12:33,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=121f209c187b30cfe80cfd9968fbab27, UNASSIGN in 267 msec 2023-07-21 20:12:33,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-21 20:12:33,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1f9de1dc28e9eee4322e5252c9c93f48, UNASSIGN in 267 msec 2023-07-21 20:12:33,407 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689970353406"}]},"ts":"1689970353406"} 2023-07-21 20:12:33,408 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-21 20:12:33,412 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-21 20:12:33,416 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 308 msec 2023-07-21 20:12:33,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 20:12:33,417 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-21 20:12:33,417 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,421 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,422 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,423 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39241] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,428 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,428 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,428 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,428 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,429 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27 2023-07-21 20:12:33,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 20:12:33,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 20:12:33,430 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 20:12:33,430 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,430 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,430 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:33,430 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:33,430 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:33,431 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-21 20:12:33,431 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 20:12:33,431 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,431 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 20:12:33,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-21 20:12:33,440 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48 2023-07-21 20:12:33,443 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/recovered.edits] 2023-07-21 20:12:33,444 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/cf, FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/recovered.edits] 2023-07-21 20:12:33,451 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/cf/aa2e5dd853aa4f8da2e54f3d3e847595 to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/cf/aa2e5dd853aa4f8da2e54f3d3e847595 2023-07-21 20:12:33,451 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/cf/51fd565d99f04817be92ccdd779d7775 to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/cf/51fd565d99f04817be92ccdd779d7775 2023-07-21 20:12:33,455 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/recovered.edits/9.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27/recovered.edits/9.seqid 2023-07-21 20:12:33,456 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/121f209c187b30cfe80cfd9968fbab27 2023-07-21 20:12:33,460 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/recovered.edits/9.seqid to hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48/recovered.edits/9.seqid 2023-07-21 20:12:33,461 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1f9de1dc28e9eee4322e5252c9c93f48 2023-07-21 20:12:33,461 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-21 20:12:33,464 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,470 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-21 20:12:33,473 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-21 20:12:33,474 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,474 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-21 20:12:33,475 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970353474"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:33,475 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689970353474"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:33,477 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 20:12:33,477 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 121f209c187b30cfe80cfd9968fbab27, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689970333230.121f209c187b30cfe80cfd9968fbab27.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1f9de1dc28e9eee4322e5252c9c93f48, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689970333230.1f9de1dc28e9eee4322e5252c9c93f48.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 20:12:33,477 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-21 20:12:33,477 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689970353477"}]},"ts":"9223372036854775807"} 2023-07-21 20:12:33,487 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-21 20:12:33,489 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,491 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 72 msec 2023-07-21 20:12:33,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-21 20:12:33,533 INFO [Listener at jenkins-hbase4.apache.org/33191] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-21 20:12:33,541 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-21 20:12:33,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,544 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-21 20:12:33,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34903] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 20:12:33,591 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 763) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2029469703_1 at /127.0.0.1:41836 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2029469703_1 at /127.0.0.1:51984 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:48354 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5209 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1181763459_17 at /127.0.0.1:41866 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:40509 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25caca0a-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=896 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=516 (was 476) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 187), AvailableMemoryMB=5390 (was 6020) 2023-07-21 20:12:33,591 WARN [Listener at jenkins-hbase4.apache.org/33191] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-21 20:12:33,591 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-21 20:12:33,617 INFO [Listener at jenkins-hbase4.apache.org/33191] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 20:12:37,608 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689970225344_0007_000001 (auth:SIMPLE) 2023-07-21 20:12:38,958 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 20:12:47,748 INFO [Listener at jenkins-hbase4.apache.org/33191] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 20:13:01,868 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 20:13:01,869 INFO [Listener at jenkins-hbase4.apache.org/33191] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 20:13:01,979 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-21 20:13:01,989 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-21 20:13:01,990 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 20:13:02,003 INFO [Listener at jenkins-hbase4.apache.org/33191] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 20:13:02,107 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 20:13:02,107 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-21 20:13:02,107 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-21 20:13:02,107 INFO [Listener at jenkins-hbase4.apache.org/33191] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 20:13:02,107 DEBUG [Listener at jenkins-hbase4.apache.org/33191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ae320dd to 127.0.0.1:57298 2023-07-21 20:13:02,107 DEBUG [Listener at jenkins-hbase4.apache.org/33191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:02,108 DEBUG [Listener at jenkins-hbase4.apache.org/33191] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-21 20:13:02,108 DEBUG [Listener at jenkins-hbase4.apache.org/33191] util.JVMClusterUtil(257): Found active master hash=780974885, stopped=false 2023-07-21 20:13:02,108 DEBUG [Listener at jenkins-hbase4.apache.org/33191] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:02,108 DEBUG [Listener at jenkins-hbase4.apache.org/33191] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 20:13:02,108 INFO [Listener at jenkins-hbase4.apache.org/33191] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34903,1689970214352 2023-07-21 20:13:02,109 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 20:13:02,110 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 20:13:02,110 INFO [Listener at jenkins-hbase4.apache.org/33191] procedure2.ProcedureExecutor(629): Stopping 2023-07-21 20:13:02,110 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 20:13:02,110 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 20:13:02,110 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:13:02,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:13:02,110 DEBUG [Listener at jenkins-hbase4.apache.org/33191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x533b692b to 127.0.0.1:57298 2023-07-21 20:13:02,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:13:02,110 DEBUG [Listener at jenkins-hbase4.apache.org/33191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:02,110 INFO [Listener at jenkins-hbase4.apache.org/33191] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39241,1689970215968' ***** 2023-07-21 20:13:02,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:13:02,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 20:13:02,111 DEBUG [Listener at jenkins-hbase4.apache.org/33191] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:02,111 INFO [Listener at jenkins-hbase4.apache.org/33191] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 20:13:02,111 INFO [Listener at jenkins-hbase4.apache.org/33191] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45843,1689970216044' ***** 2023-07-21 20:13:02,111 DEBUG [Listener at jenkins-hbase4.apache.org/33191] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:02,111 INFO [Listener at jenkins-hbase4.apache.org/33191] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 20:13:02,111 INFO [RS:0;jenkins-hbase4:39241] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 20:13:02,111 INFO [Listener at jenkins-hbase4.apache.org/33191] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38477,1689970216099' ***** 2023-07-21 20:13:02,111 INFO [RS:1;jenkins-hbase4:45843] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 20:13:02,111 INFO [RS:0;jenkins-hbase4:39241] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 20:13:02,111 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 20:13:02,111 INFO [RS:1;jenkins-hbase4:45843] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 20:13:02,111 DEBUG [Listener at jenkins-hbase4.apache.org/33191] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:02,112 INFO [RS:1;jenkins-hbase4:45843] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 20:13:02,111 INFO [RS:0;jenkins-hbase4:39241] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 20:13:02,112 INFO [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:13:02,111 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 20:13:02,112 DEBUG [RS:1;jenkins-hbase4:45843] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34dacc17 to 127.0.0.1:57298 2023-07-21 20:13:02,112 INFO [Listener at jenkins-hbase4.apache.org/33191] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 20:13:02,112 INFO [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(3305): Received CLOSE for ee8dbcb045a2834910cab769353baf79 2023-07-21 20:13:02,112 DEBUG [RS:1;jenkins-hbase4:45843] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:02,115 INFO [RS:1;jenkins-hbase4:45843] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 20:13:02,115 INFO [RS:1;jenkins-hbase4:45843] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 20:13:02,115 INFO [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(3305): Received CLOSE for 23b50f045f5f10b3590cd91ddb56138f 2023-07-21 20:13:02,115 INFO [RS:1;jenkins-hbase4:45843] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 20:13:02,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ee8dbcb045a2834910cab769353baf79, disabling compactions & flushes 2023-07-21 20:13:02,115 INFO [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-21 20:13:02,115 INFO [RS:2;jenkins-hbase4:38477] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 20:13:02,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. 2023-07-21 20:13:02,115 INFO [RS:2;jenkins-hbase4:38477] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 20:13:02,115 INFO [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:13:02,116 INFO [RS:2;jenkins-hbase4:38477] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 20:13:02,116 DEBUG [RS:0;jenkins-hbase4:39241] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c83ded0 to 127.0.0.1:57298 2023-07-21 20:13:02,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. 2023-07-21 20:13:02,116 DEBUG [RS:0;jenkins-hbase4:39241] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:02,116 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 20:13:02,116 INFO [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-21 20:13:02,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. after waiting 0 ms 2023-07-21 20:13:02,116 INFO [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:13:02,116 INFO [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-21 20:13:02,117 DEBUG [RS:2;jenkins-hbase4:38477] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42c5d4b5 to 127.0.0.1:57298 2023-07-21 20:13:02,117 DEBUG [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-21 20:13:02,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. 2023-07-21 20:13:02,117 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 20:13:02,117 DEBUG [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(1478): Online Regions={ee8dbcb045a2834910cab769353baf79=hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79., 23b50f045f5f10b3590cd91ddb56138f=hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f.} 2023-07-21 20:13:02,117 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 20:13:02,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ee8dbcb045a2834910cab769353baf79 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-21 20:13:02,117 DEBUG [RS:2;jenkins-hbase4:38477] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:02,117 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 20:13:02,118 INFO [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38477,1689970216099; all regions closed. 2023-07-21 20:13:02,118 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 20:13:02,118 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 20:13:02,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-21 20:13:02,118 DEBUG [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(1504): Waiting on 23b50f045f5f10b3590cd91ddb56138f, ee8dbcb045a2834910cab769353baf79 2023-07-21 20:13:02,118 DEBUG [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-21 20:13:02,140 DEBUG [RS:2;jenkins-hbase4:38477] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/oldWALs 2023-07-21 20:13:02,140 INFO [RS:2;jenkins-hbase4:38477] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38477%2C1689970216099:(num 1689970218431) 2023-07-21 20:13:02,141 DEBUG [RS:2;jenkins-hbase4:38477] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:02,141 INFO [RS:2;jenkins-hbase4:38477] regionserver.LeaseManager(133): Closed leases 2023-07-21 20:13:02,142 INFO [RS:2;jenkins-hbase4:38477] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-21 20:13:02,143 INFO [RS:2;jenkins-hbase4:38477] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 20:13:02,143 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 20:13:02,143 INFO [RS:2;jenkins-hbase4:38477] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 20:13:02,143 INFO [RS:2;jenkins-hbase4:38477] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 20:13:02,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/namespace/ee8dbcb045a2834910cab769353baf79/.tmp/info/2c04d3dfb5b242dbbe1b4679b69a2066 2023-07-21 20:13:02,152 INFO [RS:2;jenkins-hbase4:38477] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38477 2023-07-21 20:13:02,155 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/.tmp/info/a4326aef25df45739fcf7983a0e6eec0 2023-07-21 20:13:02,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/namespace/ee8dbcb045a2834910cab769353baf79/.tmp/info/2c04d3dfb5b242dbbe1b4679b69a2066 as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/namespace/ee8dbcb045a2834910cab769353baf79/info/2c04d3dfb5b242dbbe1b4679b69a2066 2023-07-21 20:13:02,164 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:13:02,164 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 20:13:02,164 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:13:02,164 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 20:13:02,164 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38477,1689970216099 2023-07-21 20:13:02,165 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 20:13:02,164 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 20:13:02,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/namespace/ee8dbcb045a2834910cab769353baf79/info/2c04d3dfb5b242dbbe1b4679b69a2066, entries=2, sequenceid=6, filesize=4.8 K 2023-07-21 20:13:02,165 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38477,1689970216099] 2023-07-21 20:13:02,167 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38477,1689970216099; numProcessing=1 2023-07-21 20:13:02,167 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4326aef25df45739fcf7983a0e6eec0 2023-07-21 20:13:02,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ee8dbcb045a2834910cab769353baf79 in 51ms, sequenceid=6, compaction requested=false 2023-07-21 20:13:02,172 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38477,1689970216099 already deleted, retry=false 2023-07-21 20:13:02,172 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38477,1689970216099 expired; onlineServers=2 2023-07-21 20:13:02,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/namespace/ee8dbcb045a2834910cab769353baf79/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 20:13:02,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:02,180 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 20:13:02,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. 2023-07-21 20:13:02,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ee8dbcb045a2834910cab769353baf79: 2023-07-21 20:13:02,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689970219133.ee8dbcb045a2834910cab769353baf79. 2023-07-21 20:13:02,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 23b50f045f5f10b3590cd91ddb56138f, disabling compactions & flushes 2023-07-21 20:13:02,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. 2023-07-21 20:13:02,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. 2023-07-21 20:13:02,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. after waiting 0 ms 2023-07-21 20:13:02,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. 2023-07-21 20:13:02,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 23b50f045f5f10b3590cd91ddb56138f 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-21 20:13:02,188 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-21 20:13:02,188 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-21 20:13:02,189 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 20:13:02,189 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 20:13:02,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/.tmp/rep_barrier/ddbccf541534465b9011023e1f0d92de 2023-07-21 20:13:02,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ddbccf541534465b9011023e1f0d92de 2023-07-21 20:13:02,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/acl/23b50f045f5f10b3590cd91ddb56138f/.tmp/l/80bcf52cca7a44f29f83d8b0ca5c216b 2023-07-21 20:13:02,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80bcf52cca7a44f29f83d8b0ca5c216b 2023-07-21 20:13:02,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/acl/23b50f045f5f10b3590cd91ddb56138f/.tmp/l/80bcf52cca7a44f29f83d8b0ca5c216b as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/acl/23b50f045f5f10b3590cd91ddb56138f/l/80bcf52cca7a44f29f83d8b0ca5c216b 2023-07-21 20:13:02,217 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/.tmp/table/13b86811278e4e3ab8bdee44c59c30d1 2023-07-21 20:13:02,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80bcf52cca7a44f29f83d8b0ca5c216b 2023-07-21 20:13:02,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/acl/23b50f045f5f10b3590cd91ddb56138f/l/80bcf52cca7a44f29f83d8b0ca5c216b, entries=7, sequenceid=18, filesize=5.2 K 2023-07-21 20:13:02,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 23b50f045f5f10b3590cd91ddb56138f in 38ms, sequenceid=18, compaction requested=false 2023-07-21 20:13:02,223 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13b86811278e4e3ab8bdee44c59c30d1 2023-07-21 20:13:02,224 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/.tmp/info/a4326aef25df45739fcf7983a0e6eec0 as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/info/a4326aef25df45739fcf7983a0e6eec0 2023-07-21 20:13:02,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/acl/23b50f045f5f10b3590cd91ddb56138f/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-21 20:13:02,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:02,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. 2023-07-21 20:13:02,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 23b50f045f5f10b3590cd91ddb56138f: 2023-07-21 20:13:02,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689970219889.23b50f045f5f10b3590cd91ddb56138f. 2023-07-21 20:13:02,228 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4326aef25df45739fcf7983a0e6eec0 2023-07-21 20:13:02,228 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/info/a4326aef25df45739fcf7983a0e6eec0, entries=48, sequenceid=131, filesize=10.3 K 2023-07-21 20:13:02,229 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/.tmp/rep_barrier/ddbccf541534465b9011023e1f0d92de as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/rep_barrier/ddbccf541534465b9011023e1f0d92de 2023-07-21 20:13:02,233 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ddbccf541534465b9011023e1f0d92de 2023-07-21 20:13:02,233 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/rep_barrier/ddbccf541534465b9011023e1f0d92de, entries=13, sequenceid=131, filesize=6.4 K 2023-07-21 20:13:02,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/.tmp/table/13b86811278e4e3ab8bdee44c59c30d1 as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/table/13b86811278e4e3ab8bdee44c59c30d1 2023-07-21 20:13:02,238 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13b86811278e4e3ab8bdee44c59c30d1 2023-07-21 20:13:02,238 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/table/13b86811278e4e3ab8bdee44c59c30d1, entries=24, sequenceid=131, filesize=6.9 K 2023-07-21 20:13:02,239 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 121ms, sequenceid=131, compaction requested=false 2023-07-21 20:13:02,243 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-21 20:13:02,244 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-21 20:13:02,247 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-21 20:13:02,248 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 20:13:02,248 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 20:13:02,248 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 20:13:02,249 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 20:13:02,249 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-21 20:13:02,269 INFO [RS:2;jenkins-hbase4:38477] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38477,1689970216099; zookeeper connection closed. 2023-07-21 20:13:02,269 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:02,270 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:38477-0x101898185290003, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:02,270 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@12cfc59e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@12cfc59e 2023-07-21 20:13:02,318 INFO [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39241,1689970215968; all regions closed. 2023-07-21 20:13:02,318 INFO [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45843,1689970216044; all regions closed. 2023-07-21 20:13:02,336 DEBUG [RS:0;jenkins-hbase4:39241] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/oldWALs 2023-07-21 20:13:02,336 DEBUG [RS:1;jenkins-hbase4:45843] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/oldWALs 2023-07-21 20:13:02,337 INFO [RS:1;jenkins-hbase4:45843] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45843%2C1689970216044.meta:.meta(num 1689970218691) 2023-07-21 20:13:02,336 INFO [RS:0;jenkins-hbase4:39241] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39241%2C1689970215968:(num 1689970218419) 2023-07-21 20:13:02,337 DEBUG [RS:0;jenkins-hbase4:39241] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:02,337 INFO [RS:0;jenkins-hbase4:39241] regionserver.LeaseManager(133): Closed leases 2023-07-21 20:13:02,337 INFO [RS:0;jenkins-hbase4:39241] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-21 20:13:02,337 INFO [RS:0;jenkins-hbase4:39241] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 20:13:02,337 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 20:13:02,337 INFO [RS:0;jenkins-hbase4:39241] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 20:13:02,338 INFO [RS:0;jenkins-hbase4:39241] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 20:13:02,338 INFO [RS:0;jenkins-hbase4:39241] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39241 2023-07-21 20:13:02,342 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 20:13:02,342 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:13:02,342 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39241,1689970215968 2023-07-21 20:13:02,344 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39241,1689970215968] 2023-07-21 20:13:02,344 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39241,1689970215968; numProcessing=2 2023-07-21 20:13:02,345 DEBUG [RS:1;jenkins-hbase4:45843] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/oldWALs 2023-07-21 20:13:02,346 INFO [RS:1;jenkins-hbase4:45843] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45843%2C1689970216044:(num 1689970218437) 2023-07-21 20:13:02,346 DEBUG [RS:1;jenkins-hbase4:45843] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:02,346 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39241,1689970215968 already deleted, retry=false 2023-07-21 20:13:02,346 INFO [RS:1;jenkins-hbase4:45843] regionserver.LeaseManager(133): Closed leases 2023-07-21 20:13:02,346 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39241,1689970215968 expired; onlineServers=1 2023-07-21 20:13:02,346 INFO [RS:1;jenkins-hbase4:45843] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-21 20:13:02,346 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 20:13:02,347 INFO [RS:1;jenkins-hbase4:45843] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45843 2023-07-21 20:13:02,349 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45843,1689970216044 2023-07-21 20:13:02,349 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 20:13:02,351 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45843,1689970216044] 2023-07-21 20:13:02,351 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45843,1689970216044; numProcessing=3 2023-07-21 20:13:02,352 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45843,1689970216044 already deleted, retry=false 2023-07-21 20:13:02,352 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45843,1689970216044 expired; onlineServers=0 2023-07-21 20:13:02,352 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34903,1689970214352' ***** 2023-07-21 20:13:02,352 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-21 20:13:02,352 DEBUG [M:0;jenkins-hbase4:34903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fb1b11e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 20:13:02,352 INFO [M:0;jenkins-hbase4:34903] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34903,1689970214352 2023-07-21 20:13:02,352 INFO [M:0;jenkins-hbase4:34903] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34903,1689970214352; all regions closed. 2023-07-21 20:13:02,352 DEBUG [M:0;jenkins-hbase4:34903] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 20:13:02,352 DEBUG [M:0;jenkins-hbase4:34903] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-21 20:13:02,353 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-21 20:13:02,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689970217820] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689970217820,5,FailOnTimeoutGroup] 2023-07-21 20:13:02,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689970217820] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689970217820,5,FailOnTimeoutGroup] 2023-07-21 20:13:02,353 DEBUG [M:0;jenkins-hbase4:34903] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-21 20:13:02,353 INFO [M:0;jenkins-hbase4:34903] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-21 20:13:02,353 INFO [M:0;jenkins-hbase4:34903] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-21 20:13:02,353 INFO [M:0;jenkins-hbase4:34903] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-21 20:13:02,353 DEBUG [M:0;jenkins-hbase4:34903] master.HMaster(1512): Stopping service threads 2023-07-21 20:13:02,353 INFO [M:0;jenkins-hbase4:34903] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-21 20:13:02,353 ERROR [M:0;jenkins-hbase4:34903] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-07-21 20:13:02,353 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-21 20:13:02,354 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 20:13:02,354 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 20:13:02,354 INFO [M:0;jenkins-hbase4:34903] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-21 20:13:02,354 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-21 20:13:02,355 DEBUG [M:0;jenkins-hbase4:34903] zookeeper.ZKUtil(398): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-21 20:13:02,355 WARN [M:0;jenkins-hbase4:34903] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-21 20:13:02,355 INFO [M:0;jenkins-hbase4:34903] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-21 20:13:02,355 INFO [M:0;jenkins-hbase4:34903] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-21 20:13:02,355 DEBUG [M:0;jenkins-hbase4:34903] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 20:13:02,355 INFO [M:0;jenkins-hbase4:34903] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:13:02,355 DEBUG [M:0;jenkins-hbase4:34903] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:13:02,355 DEBUG [M:0;jenkins-hbase4:34903] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 20:13:02,355 DEBUG [M:0;jenkins-hbase4:34903] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:13:02,355 INFO [M:0;jenkins-hbase4:34903] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.08 KB heapSize=449.27 KB 2023-07-21 20:13:02,369 INFO [M:0;jenkins-hbase4:34903] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.08 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f37f11e6306d4322860d880d585ca91d 2023-07-21 20:13:02,373 INFO [M:0;jenkins-hbase4:34903] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f37f11e6306d4322860d880d585ca91d 2023-07-21 20:13:02,374 DEBUG [M:0;jenkins-hbase4:34903] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f37f11e6306d4322860d880d585ca91d as hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f37f11e6306d4322860d880d585ca91d 2023-07-21 20:13:02,377 INFO [M:0;jenkins-hbase4:34903] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f37f11e6306d4322860d880d585ca91d 2023-07-21 20:13:02,377 INFO [M:0;jenkins-hbase4:34903] regionserver.HStore(1080): Added hdfs://localhost:33875/user/jenkins/test-data/8e8dc6dd-b866-6c2f-fe65-5ea4b0e88091/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f37f11e6306d4322860d880d585ca91d, entries=119, sequenceid=899, filesize=28.4 K 2023-07-21 20:13:02,378 INFO [M:0;jenkins-hbase4:34903] regionserver.HRegion(2948): Finished flush of dataSize ~373.08 KB/382033, heapSize ~449.26 KB/460040, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-07-21 20:13:02,379 INFO [M:0;jenkins-hbase4:34903] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 20:13:02,379 DEBUG [M:0;jenkins-hbase4:34903] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 20:13:02,383 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 20:13:02,383 INFO [M:0;jenkins-hbase4:34903] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-21 20:13:02,383 INFO [M:0;jenkins-hbase4:34903] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34903 2023-07-21 20:13:02,386 DEBUG [M:0;jenkins-hbase4:34903] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34903,1689970214352 already deleted, retry=false 2023-07-21 20:13:02,445 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:02,445 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:39241-0x101898185290001, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:02,445 INFO [RS:0;jenkins-hbase4:39241] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39241,1689970215968; zookeeper connection closed. 2023-07-21 20:13:02,445 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@65a5b390] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@65a5b390 2023-07-21 20:13:02,545 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:02,545 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): master:34903-0x101898185290000, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:02,545 INFO [M:0;jenkins-hbase4:34903] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34903,1689970214352; zookeeper connection closed. 2023-07-21 20:13:02,645 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:02,645 DEBUG [Listener at localhost/35517-EventThread] zookeeper.ZKWatcher(600): regionserver:45843-0x101898185290002, quorum=127.0.0.1:57298, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 20:13:02,645 INFO [RS:1;jenkins-hbase4:45843] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45843,1689970216044; zookeeper connection closed. 2023-07-21 20:13:02,645 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@56ed293d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@56ed293d 2023-07-21 20:13:02,646 INFO [Listener at jenkins-hbase4.apache.org/33191] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-21 20:13:02,646 WARN [Listener at jenkins-hbase4.apache.org/33191] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 20:13:02,650 INFO [Listener at jenkins-hbase4.apache.org/33191] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 20:13:02,753 WARN [BP-1620635269-172.31.14.131-1689970210026 heartbeating to localhost/127.0.0.1:33875] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 20:13:02,753 WARN [BP-1620635269-172.31.14.131-1689970210026 heartbeating to localhost/127.0.0.1:33875] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1620635269-172.31.14.131-1689970210026 (Datanode Uuid 79f0fc0d-0225-48fb-8dd9-bb207d95cd75) service to localhost/127.0.0.1:33875 2023-07-21 20:13:02,755 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/dfs/data/data5/current/BP-1620635269-172.31.14.131-1689970210026] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 20:13:02,755 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/dfs/data/data6/current/BP-1620635269-172.31.14.131-1689970210026] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 20:13:02,757 WARN [Listener at jenkins-hbase4.apache.org/33191] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 20:13:02,761 INFO [Listener at jenkins-hbase4.apache.org/33191] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 20:13:02,865 WARN [BP-1620635269-172.31.14.131-1689970210026 heartbeating to localhost/127.0.0.1:33875] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 20:13:02,865 WARN [BP-1620635269-172.31.14.131-1689970210026 heartbeating to localhost/127.0.0.1:33875] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1620635269-172.31.14.131-1689970210026 (Datanode Uuid 331c68a0-81aa-400f-a0c0-f1a987c842fa) service to localhost/127.0.0.1:33875 2023-07-21 20:13:02,866 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/dfs/data/data4/current/BP-1620635269-172.31.14.131-1689970210026] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 20:13:02,866 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/dfs/data/data3/current/BP-1620635269-172.31.14.131-1689970210026] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 20:13:02,867 WARN [Listener at jenkins-hbase4.apache.org/33191] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 20:13:02,870 INFO [Listener at jenkins-hbase4.apache.org/33191] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 20:13:02,873 WARN [BP-1620635269-172.31.14.131-1689970210026 heartbeating to localhost/127.0.0.1:33875] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 20:13:02,873 WARN [BP-1620635269-172.31.14.131-1689970210026 heartbeating to localhost/127.0.0.1:33875] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1620635269-172.31.14.131-1689970210026 (Datanode Uuid aac4036e-5602-4c91-a2b8-e1c8cd691f28) service to localhost/127.0.0.1:33875 2023-07-21 20:13:02,874 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/dfs/data/data1/current/BP-1620635269-172.31.14.131-1689970210026] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 20:13:02,874 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/71c41cf0-58fa-25e6-503d-ccf4ed428abd/cluster_a9af73bd-9dde-6daa-eb11-ec6d4a19bca6/dfs/data/data2/current/BP-1620635269-172.31.14.131-1689970210026] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 20:13:02,897 INFO [Listener at jenkins-hbase4.apache.org/33191] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 20:13:03,022 INFO [Listener at jenkins-hbase4.apache.org/33191] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-21 20:13:03,114 INFO [Listener at jenkins-hbase4.apache.org/33191] hbase.HBaseTestingUtility(1293): Minicluster is down